-- Logs begin at Tue 2022-06-07 13:30:48 UTC, end at Tue 2022-06-07 14:43:12 UTC. -- Jun 07 14:12:18.269743 dv-cinder-836083-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 07 14:12:18.277075 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 07 14:12:18.279169 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 7 14:12:18 2022] *** Jun 07 14:12:18.279169 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 07 14:12:18.279169 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 07 14:12:18.279169 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: nodename: dv-cinder-836083-9-iscsi Jun 07 14:12:18.279169 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: machine: x86_64 Jun 07 14:12:18.279169 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: clock source: unix Jun 07 14:12:18.279169 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: pcre jit disabled Jun 07 14:12:18.279169 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: detected number of CPU cores: 4 Jun 07 14:12:18.279169 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: current working directory: / Jun 07 14:12:18.279169 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: detected binary path: /usr/bin/uwsgi-core Jun 07 14:12:18.279799 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: your processes number limit is 47680 Jun 07 14:12:18.279799 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: your memory page size is 4096 bytes Jun 07 14:12:18.279799 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: detected max file descriptor number: 2048 Jun 07 14:12:18.279799 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: lock engine: pthread robust mutexes Jun 07 14:12:18.280585 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: thunder lock: enabled Jun 07 14:12:18.280692 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 07 14:12:18.280692 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 07 14:12:18.325627 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: Python main interpreter initialized at 0x5581d2f1c9c0 Jun 07 14:12:18.325627 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: python threads support enabled Jun 07 14:12:18.325627 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: your server socket listen backlog is limited to 100 connections Jun 07 14:12:18.325627 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: your mercy for graceful operations on workers is 90 seconds Jun 07 14:12:18.326004 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: mapped 403077 bytes (393 KB) for 2 cores Jun 07 14:12:18.326080 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: *** Operational MODE: preforking *** Jun 07 14:12:18.326295 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: *** uWSGI is running in multiple interpreter mode *** Jun 07 14:12:18.326295 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: spawned uWSGI master process (pid: 103150) Jun 07 14:12:18.326514 dv-cinder-836083-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 07 14:12:18.327085 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: spawned uWSGI worker 1 (pid: 103151, cores: 1) Jun 07 14:12:18.327894 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: spawned uWSGI worker 2 (pid: 103152, cores: 1) Jun 07 14:12:18.327894 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 07 14:12:19.561399 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 14:12:19.570424 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 14:12:20.281414 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 14:12:20.281414 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: from cryptography.utils import int_from_bytes Jun 07 14:12:20.281728 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 14:12:20.281728 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: from cryptography.utils import int_from_bytes Jun 07 14:12:20.284092 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 14:12:20.284092 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: from cryptography.utils import int_from_bytes Jun 07 14:12:20.284432 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 14:12:20.284432 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: from cryptography.utils import int_from_bytes Jun 07 14:12:22.894319 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 14:12:22.894881 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 14:12:22.895077 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 14:12:22.895464 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 14:12:22.895717 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 14:12:22.896099 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.896420 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.896736 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.897050 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.897375 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.897682 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.897997 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.898309 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.898630 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.898786 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 14:12:22.899157 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.899262 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 14:12:22.899356 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.899532 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-9-iscsi {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.899627 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 14:12:22.899850 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.899945 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 14:12:22.900153 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.900239 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 14:12:22.900458 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.900545 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.900772 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.900878 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.901074 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.901163 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.901392 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.901487 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.901694 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.901792 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.902050 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.902182 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.902364 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.902781 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.902911 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.903044 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.903302 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.903426 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.903568 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.903695 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.903885 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.904012 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.904208 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-9-iscsi {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.904322 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.904528 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.904625 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.904833 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.904931 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.905143 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.905229 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.905460 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.905547 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.905764 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.905906 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-9-iscsi {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.906084 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.906217 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.906387 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.906525 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.906834 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.906929 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.907180 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.907295 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.907510 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.907598 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.907817 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.907913 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.908146 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.908239 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.908453 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.908536 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.908757 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.908843 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.909073 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.909157 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.909376 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.909549 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.909688 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.909789 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.909990 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.910085 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.910289 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.910375 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-9-iscsi {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.910591 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.910684 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.910895 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.910983 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.911208 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.911318 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.911529 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.911674 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.911829 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.911981 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.912067 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.912285 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.912378 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.912602 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.912689 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.912920 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.913007 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.913221 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.913319 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.913514 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.913601 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.913759 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.913847 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.914074 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.914172 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.914390 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.914478 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.914691 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.914778 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.914992 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.915087 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.915344 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.915442 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.915644 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.915729 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.915943 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.916048 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.916242 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.916336 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.916486 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.916579 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.916794 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.916892 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.917109 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.917197 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.917423 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.917516 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.917737 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.917823 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.917985 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.918070 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.918775 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.918940 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.919336 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.919528 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.919667 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.919784 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.919976 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.920080 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.920282 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.920415 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.920587 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.920730 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.920892 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.921037 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.921197 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.921352 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.921502 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.921709 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.921812 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.921973 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.922092 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.922275 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.922406 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.922576 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.922717 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.922891 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.923035 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.923211 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.923371 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.923616 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.923731 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.923892 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.924067 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.924210 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.924318 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.924450 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.924603 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.924763 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.924935 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.925065 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.925249 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.925365 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.925553 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.925667 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.925866 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.925963 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.926181 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.926267 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.926481 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.926575 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.926782 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.926868 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.927080 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.927199 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.927425 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.927520 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.927725 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.927820 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.928027 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.928122 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.928271 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.928363 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.928566 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.928652 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.928866 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.928961 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.929181 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.929267 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.929482 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.929574 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.929782 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.929877 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.930083 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.930177 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.930379 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.930467 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.930679 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.930774 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.930979 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.931074 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.931300 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.931390 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.931603 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.931746 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.931903 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.931990 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.932202 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.932297 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.932501 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.932594 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.932801 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.932887 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.933100 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.933186 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.933416 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.933503 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.933710 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.934495 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.934684 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.934783 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.935004 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.935162 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.935332 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.935500 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.935668 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.935809 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.935909 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.936131 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.936218 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.936438 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.936524 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.936744 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.936839 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.937066 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.937159 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.937361 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.937446 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.937658 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.937756 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.937971 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.938063 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.938273 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.938358 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.938575 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.938668 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.938878 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.938965 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.939173 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.939329 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.939506 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.939620 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.939819 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.939957 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.940122 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.940210 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.940426 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.940544 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.940725 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.940858 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.941024 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.941187 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.941324 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.941516 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.941625 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.941831 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.941926 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.942142 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.942230 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.942454 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.942540 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.942774 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.942860 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.943083 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.943170 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.943411 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.943508 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.943714 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.943800 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.944015 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.944101 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.944325 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.944409 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:12:22.944650 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.944737 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.944960 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.945093 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.945276 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.945375 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.945587 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.945688 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.945892 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.945986 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.946202 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.946288 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.946523 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.946619 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.946832 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.946979 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.947137 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.947250 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.947495 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.947596 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.947836 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.947922 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.948139 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.948224 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.948447 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.948546 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.948761 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.948847 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.949069 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.949163 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.949415 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.949511 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.949730 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.949950 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.950135 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.950357 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.950446 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.950665 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.950751 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.950973 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.951066 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.951303 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.951394 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.951616 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.951707 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.951925 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.952012 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.952251 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.952357 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.952535 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.952620 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.952868 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.952963 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.953179 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.953275 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.953496 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.953591 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.953805 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.953893 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.954108 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.954204 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.954413 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.954499 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.954715 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.954800 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.955020 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.955114 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.955349 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.955438 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.955660 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.955756 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.955956 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.956050 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.956264 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.956350 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.956564 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.956648 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.956869 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.956955 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.957177 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.957270 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.957483 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.957568 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.957811 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.957901 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.958114 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.958203 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.958421 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.958513 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.958726 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.958825 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.959032 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.959120 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.959362 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.959469 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.959669 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.959802 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.959973 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.960058 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.960274 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.960371 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.960572 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.960658 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.960872 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.960959 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.961177 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.961270 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.961475 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.961561 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.961783 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.961875 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.962084 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.962180 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.962395 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.962481 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.962700 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.962786 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.963007 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.963095 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.963337 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.963423 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.963644 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.963742 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.963949 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.964045 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.964251 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.964338 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.964558 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.964643 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.964862 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.964955 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.965267 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.965361 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.965664 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.965761 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.966019 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.966116 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.966342 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.966429 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.966657 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.966752 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.966960 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.967045 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.967289 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.967392 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.967590 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.967686 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.967890 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.967986 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.968190 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.968278 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.968494 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.968591 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.968795 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.968888 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.969097 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.969184 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.969395 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.969490 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.969696 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.969783 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.969996 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.970090 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.970313 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.970401 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.970617 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.970704 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.970914 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.971000 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.971213 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.971314 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.971535 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.971632 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.971865 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.971962 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.972163 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.972250 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.972460 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.972545 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.972760 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.972845 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.973060 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.973155 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.973363 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.973450 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.973661 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.973757 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.973961 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.974050 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.974259 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.974346 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.974557 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.974652 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.974857 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.974992 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.975175 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.975317 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.975505 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.975607 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.975803 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.975899 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.976101 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.976189 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.976399 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.976494 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.976715 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.976801 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.977020 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.977108 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.977333 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.977420 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.977634 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.977720 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.977944 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.978032 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.978277 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.978364 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.978583 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.978675 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.978893 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.978979 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.979201 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.979307 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.979526 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.979623 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.979830 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.979916 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.980133 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.980219 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.980438 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.980535 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.981278 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.981376 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.981604 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.981821 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.981958 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.982142 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.982265 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.982468 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.982565 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.982781 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.982873 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.983098 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.983184 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.983457 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.983541 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.983729 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.983824 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.984030 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.984116 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.984341 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.984429 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.984662 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.984748 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.984991 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.985083 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.985299 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.985387 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.985610 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.985704 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.985916 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.986017 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.986222 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.986310 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.986529 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.986617 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.986837 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.987001 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.987139 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.987271 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.987464 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.987552 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.987769 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.987867 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.988076 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.988170 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.988378 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.988463 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.988684 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.988781 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.988985 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.989072 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.989284 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.989369 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.989838 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.989925 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.990138 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.990224 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.990439 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.990525 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.990748 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.990836 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.991063 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.991148 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.991391 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.991480 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.991705 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.991800 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.992011 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.992097 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.992310 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.992402 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.992609 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.992696 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.992910 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.993006 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.993216 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.993310 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.993513 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.993599 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.993819 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.993904 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.994116 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.994214 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.994417 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.994502 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.994728 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.994815 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.995032 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.995169 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.995354 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.995453 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.995654 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.995740 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.995959 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.996056 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.996330 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.996415 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.996814 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.996901 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.997190 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.997285 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.997518 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.997604 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.997830 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.997918 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.998155 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.998242 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.998465 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.998552 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.998774 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.998860 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.999081 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.999169 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.999424 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.999523 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.999727 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:22.999812 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.000041 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.000128 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.000348 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.000436 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.000648 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.000733 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.000946 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.001031 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.001252 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.001339 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.001556 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.001649 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.001866 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.002117 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.002204 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.002446 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.002532 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.002757 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.002844 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.003063 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.003147 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.003395 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.003496 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.003703 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.003799 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.004010 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.004097 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.004316 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.004462 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.004622 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.004710 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.004939 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.005036 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.005243 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.005328 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.005545 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.005641 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.005846 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.005935 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.006144 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.006237 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.006444 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.006532 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.006742 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.006829 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.007042 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.007316 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.007420 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.007646 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.007732 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.007941 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.008025 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.008239 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.008342 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.008538 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.008626 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.008845 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.008932 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.009143 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.009239 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.009447 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.009534 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.009744 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.009838 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.010061 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.010157 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.010365 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.010459 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.010663 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.010750 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.010959 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.011045 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.011303 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.011396 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.011609 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.011695 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.012454 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.012606 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.012846 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.012962 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.013272 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.013367 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.013626 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.013722 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.013933 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.014021 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.014238 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.014332 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.014556 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.014650 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.014858 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.014944 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.015160 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.015307 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.015486 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.015588 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.015791 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.015876 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.016093 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.016179 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.016407 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.016494 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.016711 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.017015 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.017315 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.017560 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.017663 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.017967 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.018274 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.018367 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.018610 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.018687 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.018940 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.019017 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.019296 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.019385 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.019601 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.019700 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.019904 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.019990 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.020211 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.020302 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.020514 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.020610 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.020814 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.020901 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.021116 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.021201 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.021417 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.021514 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.021716 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.021804 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.022014 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.022100 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.022311 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.022411 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.022622 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.022750 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.022919 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.023018 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.023271 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.023382 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.023541 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.023629 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.023845 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.023930 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.024147 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.024240 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.024451 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.024538 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.024754 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.024839 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.025055 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.025143 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.025354 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.025487 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.025656 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.025743 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.025958 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.026044 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.026255 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.026341 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.026553 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.026639 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.026848 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.026934 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.027158 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.027276 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.027644 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.027761 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.027930 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.028051 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.028405 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.028493 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.028717 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.028812 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.029021 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.029122 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.029322 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.029408 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.029624 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.029722 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.029923 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.030019 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.030222 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.030316 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.030518 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.030615 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.030818 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.030954 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.031117 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.031204 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.031453 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.031542 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.031755 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.031842 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.032077 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.032175 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.032391 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.032479 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.032703 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.032838 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.032999 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.033087 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.033300 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.033387 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.033599 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.033687 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.033897 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.033983 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.034199 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.034287 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.034497 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.034584 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.034796 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.034892 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.035092 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.035187 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.035418 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.035545 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.035717 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.035814 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.036023 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.036109 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.036326 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.036411 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.036624 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.036720 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.036921 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.037055 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.037216 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.037301 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.037530 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.037624 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.037837 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.037924 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.038143 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.038235 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.038459 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.038548 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.038771 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.038856 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.039082 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.039200 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.039408 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.039498 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.039718 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.039804 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.040025 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.040110 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.040325 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.040419 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.040628 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.040722 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.040931 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.041063 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.041228 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.041311 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.041526 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.041612 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.041825 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.041920 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.042129 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.042215 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.042432 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.042517 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.042733 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.042832 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.043041 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.043161 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.043557 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.043648 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.043869 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.044103 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.044192 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.044410 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.044496 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.044721 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.044808 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.045030 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.045117 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.045338 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.045424 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.045646 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.045741 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.045947 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.046046 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.046255 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.046371 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.046565 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.046666 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.046873 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.046961 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.047181 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.047298 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.047517 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.047655 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.047826 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.047968 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.048133 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.048282 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.048439 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.048592 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.048741 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.048893 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.049064 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.049308 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.049403 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.049615 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.049702 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.049921 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.050008 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.050228 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.050325 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.050529 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.050617 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.050828 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.050916 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.051132 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.051287 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.051475 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.051562 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.051775 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.051871 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.052076 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.052177 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.052376 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.052471 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.052694 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.052781 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.052995 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.053083 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.053311 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.053406 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.053630 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.053717 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.054022 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.054108 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.054322 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.054410 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.054634 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.054719 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.054940 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.055027 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.055259 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.055350 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.055564 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.055653 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.055870 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.055971 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.056190 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.056289 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.056490 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.056589 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.056792 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.056888 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.057094 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.057181 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.057412 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.057507 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.057714 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.057800 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.058038 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.058123 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.058346 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.058440 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.058648 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.059277 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.059531 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.059747 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.059836 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.060151 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.060276 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.060472 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.060589 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.060882 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.060978 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.061202 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.061290 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.061512 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.061600 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.061828 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.061926 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.062129 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.062228 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.062439 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.062525 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.062741 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.062829 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.063049 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.063193 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.063396 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.063485 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.063704 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.063823 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.064017 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.064121 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.064319 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.064414 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.064634 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.064728 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.064943 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.065039 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.065250 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.065338 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.065550 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.065645 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.065853 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.065951 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.066171 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.066259 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.066471 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.066557 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.066788 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.066876 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.067096 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.067190 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.067437 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.067538 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.067755 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.067843 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.068058 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.068146 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.068369 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.068455 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.068670 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.068769 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.068968 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.069053 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.069268 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.069364 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.069568 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.069655 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.069871 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.069956 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.070175 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.070269 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.070475 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.070562 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.070774 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.070862 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.071091 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.071192 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.071420 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.071510 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.071740 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.071826 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.072050 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.072150 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.072362 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.072448 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.072678 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.072772 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.072978 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.073101 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.073288 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.073374 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.073591 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.073687 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.073888 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.073975 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.074190 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.074275 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.074540 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.074635 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.074921 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.075106 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.075272 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.075445 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.075545 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.075767 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.075864 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.076098 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.076184 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.076425 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.076520 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.076725 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.076820 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.077045 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.077212 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.077350 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.077558 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.077660 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.077873 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.077960 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.078190 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.078277 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.078520 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.078616 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.078825 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.078912 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.079129 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.079234 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.079461 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.079566 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.079764 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.079855 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.080065 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.080160 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.080367 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.080455 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.080673 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.080768 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.080973 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.081068 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.081273 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.081364 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.081572 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.081659 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.081880 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.081973 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.082179 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.082266 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.082487 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.082572 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.082796 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.082883 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.083095 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.083279 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.083419 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.083512 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.083711 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.083809 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.084021 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.084107 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.084334 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.084540 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.084664 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.084862 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.084978 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.085173 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.085298 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.085479 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.085620 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.085785 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.085926 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.086091 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.086244 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.086400 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.086556 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.086707 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.086873 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.087095 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.087196 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.087426 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.087530 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.087734 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.087833 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.088059 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.088147 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.088378 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.088476 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.088699 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.088785 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.089011 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.089098 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.089322 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.089419 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.089630 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.089716 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.089942 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.090764 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.090866 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.091286 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.091401 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.091610 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.091699 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.091913 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.092008 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.092225 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.092312 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.092535 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.092621 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.092844 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.092940 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.093152 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.093239 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.093460 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.093566 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.093765 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.093852 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.094072 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.094165 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.094379 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.094471 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.094690 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.094786 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.094998 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.095084 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.095328 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.095430 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.095653 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.095742 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.095966 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.096054 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.096278 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.096378 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.096584 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.096670 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.096893 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.096980 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.097204 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.097300 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.097520 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.097716 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.097833 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.098026 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.098144 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.098354 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.098452 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.098677 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.098771 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.098996 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.099092 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.099332 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.099456 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.099647 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.099768 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.099970 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.100072 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.100275 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.100362 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.100578 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.100664 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.100887 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.100985 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.101194 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.101288 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.101494 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.101581 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.101813 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.101950 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.102120 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.102207 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.102417 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.102548 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.102733 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.102822 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.103039 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.103295 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.103594 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.103749 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.103927 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.104015 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.104236 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.104321 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.104557 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.104652 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.104868 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.104954 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.105179 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.105265 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.105483 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.105743 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.105965 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.106053 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.106276 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.106420 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.106581 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.106736 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.106892 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.107046 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.107200 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.107376 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.107524 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.107697 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.107826 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.108008 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.108134 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.108310 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.108439 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.108628 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.108740 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.108941 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.109066 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.109334 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.109467 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.109655 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.109810 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.109957 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.110122 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.110336 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.110434 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.110642 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.110753 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.110949 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.111068 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.111276 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.111479 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.111586 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.111707 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.111893 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.112013 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.112195 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.112317 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.112503 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.112632 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.112805 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.112940 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.113114 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.113242 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.113415 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.113547 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.113724 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.113841 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.114024 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.114147 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.114330 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.114701 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.114935 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.115022 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.115280 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.115372 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.115585 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.115672 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.115886 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.115985 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.116198 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.116292 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.116502 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.116588 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.116812 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.116908 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.117112 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.117199 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.117412 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.117498 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.117716 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.117812 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.118017 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.118112 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.118326 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.118568 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.118657 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.118901 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.118989 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.119242 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.119331 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.119543 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.119647 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.119845 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.119932 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.120150 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.120238 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.120477 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.120575 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.120784 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.120873 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.121094 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.121180 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.121985 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.122083 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.122305 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.122563 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.122651 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.122940 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.123053 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.123294 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.123391 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.123608 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.123711 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.123917 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.124014 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.124224 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.124310 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.124532 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.124619 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.124843 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.125080 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.125169 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.125413 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.125500 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.125733 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.125820 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.126043 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.126130 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.126382 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.126468 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.126690 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.126786 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.126995 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.127089 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.127328 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.127418 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.127644 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.127742 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.127950 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.128036 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.128256 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.128343 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.128560 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.128656 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.128863 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.128953 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.129168 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.129296 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.129481 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.129588 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.129786 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.129875 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.130085 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.130171 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.130387 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.130503 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.130692 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.130811 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.130998 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.131127 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.131328 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.131467 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.131635 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.131775 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.131943 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.132092 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.132280 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.132409 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.132595 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.132718 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.132908 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.133036 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.133224 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.133343 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.133538 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.133672 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.133853 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.134006 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.134154 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.134330 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.134459 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.134657 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.134752 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.134961 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.135058 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.135283 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.135408 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.135587 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.135723 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.135895 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.136025 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.136211 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.136441 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.136529 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.136751 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.136939 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.137366 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.137454 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.137535 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.137622 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.137751 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.137939 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.138035 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.138262 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.138350 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.138585 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.138675 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.138896 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.138992 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.139202 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.139374 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.139526 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.139616 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.139827 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.139915 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.140127 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.140216 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.140428 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.140517 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.140730 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.140817 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.141035 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.141122 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.141335 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.141425 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.141635 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.141723 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.141933 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.142033 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.142233 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.142321 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.142532 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.142626 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.142848 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.142943 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.143151 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.143268 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.143488 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.143575 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.143795 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.143916 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.144099 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.144202 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.144445 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.144545 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.144702 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.144804 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.145006 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.145095 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.145307 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.145443 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.145607 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.145696 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.145908 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.146003 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.146207 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.146294 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.146510 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.146598 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.146809 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.146896 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.147114 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.147201 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.147440 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.147532 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.147743 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.147830 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.148042 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.148129 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.148342 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.148438 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.148643 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.148738 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.148966 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.149061 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.149290 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.149379 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.149605 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.149693 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.149921 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.150018 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.150226 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.150311 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.150530 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.150628 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.150837 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.150970 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.151153 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.151297 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.151489 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.151614 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.151801 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.151915 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.152167 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.152290 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.152405 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.153059 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.153365 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.153492 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.153729 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.153927 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.154068 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.154245 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.154373 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.154515 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.154676 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.154846 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.155010 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.155158 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.155361 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.155518 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.155710 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.155846 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.156024 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.156153 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.156368 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.156483 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.156697 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.156789 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.157011 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.157152 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.157323 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.157470 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.157625 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.157781 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.157868 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 14:12:23.158111 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.158419 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.158729 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.159041 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.159536 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.159854 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.160170 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.160485 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.160811 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.161133 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.161444 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.161767 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.162092 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.162441 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.162749 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.163089 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.163444 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.163761 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.164072 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.164377 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:12:23.164617 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 14:12:23.216654 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO dbcounter [None req-5a2b0c2d-df15-4aad-bfa3-709f75a0f89c None None] Registered counter for database nova_api Jun 07 14:12:23.224571 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO dbcounter [None req-16e77b39-bed7-49a3-9dc4-45d21ffb7691 None None] Registered counter for database nova_api Jun 07 14:12:23.237764 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG oslo_db.sqlalchemy.engines [None req-5a2b0c2d-df15-4aad-bfa3-709f75a0f89c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:12:23.244474 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG oslo_db.sqlalchemy.engines [None req-16e77b39-bed7-49a3-9dc4-45d21ffb7691 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103152) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:12:23.244785 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writer thread running {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:12:23.251630 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG dbcounter [-] [103152] Writer thread running {{(pid=103152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:12:23.303663 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.context [None req-5a2b0c2d-df15-4aad-bfa3-709f75a0f89c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c8a811e3-dd56-4d67-9958-d177193c9c7e(cell1) {{(pid=103151) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 14:12:23.307788 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-5a2b0c2d-df15-4aad-bfa3-709f75a0f89c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:12:23.309605 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-5a2b0c2d-df15-4aad-bfa3-709f75a0f89c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:12:23.310382 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-5a2b0c2d-df15-4aad-bfa3-709f75a0f89c None None] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:12:23.311035 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.context [None req-16e77b39-bed7-49a3-9dc4-45d21ffb7691 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c8a811e3-dd56-4d67-9958-d177193c9c7e(cell1) {{(pid=103152) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 14:12:23.312360 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-5a2b0c2d-df15-4aad-bfa3-709f75a0f89c None None] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:12:23.314317 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO dbcounter [None req-5a2b0c2d-df15-4aad-bfa3-709f75a0f89c None None] Registered counter for database nova_cell0 Jun 07 14:12:23.315333 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG oslo_concurrency.lockutils [None req-16e77b39-bed7-49a3-9dc4-45d21ffb7691 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:12:23.316981 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG oslo_concurrency.lockutils [None req-16e77b39-bed7-49a3-9dc4-45d21ffb7691 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:12:23.317760 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG oslo_concurrency.lockutils [None req-16e77b39-bed7-49a3-9dc4-45d21ffb7691 None None] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:12:23.318246 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO dbcounter [None req-5a2b0c2d-df15-4aad-bfa3-709f75a0f89c None None] Registered counter for database nova_cell1 Jun 07 14:12:23.319710 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG oslo_concurrency.lockutils [None req-16e77b39-bed7-49a3-9dc4-45d21ffb7691 None None] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:12:23.321754 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO dbcounter [None req-16e77b39-bed7-49a3-9dc4-45d21ffb7691 None None] Registered counter for database nova_cell0 Jun 07 14:12:23.326060 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG oslo_db.sqlalchemy.engines [None req-5a2b0c2d-df15-4aad-bfa3-709f75a0f89c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:12:23.326335 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO dbcounter [None req-16e77b39-bed7-49a3-9dc4-45d21ffb7691 None None] Registered counter for database nova_cell1 Jun 07 14:12:23.327736 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG oslo_db.sqlalchemy.engines [None req-5a2b0c2d-df15-4aad-bfa3-709f75a0f89c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:12:23.332867 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writer thread running {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:12:23.336141 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG oslo_db.sqlalchemy.engines [None req-16e77b39-bed7-49a3-9dc4-45d21ffb7691 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103152) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:12:23.336967 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG oslo_db.sqlalchemy.engines [None req-16e77b39-bed7-49a3-9dc4-45d21ffb7691 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103152) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:12:23.344531 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG dbcounter [-] [103152] Writer thread running {{(pid=103152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:12:23.345835 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG dbcounter [-] [103152] Writer thread running {{(pid=103152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:12:23.471998 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writer thread running {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:12:23.481837 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO dbcounter [None req-5a2b0c2d-df15-4aad-bfa3-709f75a0f89c None None] Registered counter for database nova_cell0 Jun 07 14:12:23.490820 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG oslo_db.sqlalchemy.engines [None req-5a2b0c2d-df15-4aad-bfa3-709f75a0f89c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:12:23.492474 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO dbcounter [None req-16e77b39-bed7-49a3-9dc4-45d21ffb7691 None None] Registered counter for database nova_cell0 Jun 07 14:12:23.495119 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writer thread running {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:12:23.500698 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG oslo_db.sqlalchemy.engines [None req-16e77b39-bed7-49a3-9dc4-45d21ffb7691 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103152) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:12:23.505130 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG dbcounter [-] [103152] Writer thread running {{(pid=103152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:12:23.951590 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: WARNING keystonemiddleware.auth_token [None req-5a2b0c2d-df15-4aad-bfa3-709f75a0f89c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 14:12:23.958725 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: WARNING keystonemiddleware.auth_token [None req-5a2b0c2d-df15-4aad-bfa3-709f75a0f89c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 14:12:23.960471 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: WARNING keystonemiddleware.auth_token [None req-16e77b39-bed7-49a3-9dc4-45d21ffb7691 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 14:12:23.967780 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: WARNING keystonemiddleware.auth_token [None req-16e77b39-bed7-49a3-9dc4-45d21ffb7691 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 14:12:24.180371 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: WARNING keystonemiddleware.auth_token [None req-5a2b0c2d-df15-4aad-bfa3-709f75a0f89c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 14:12:24.186461 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: WARNING keystonemiddleware.auth_token [None req-5a2b0c2d-df15-4aad-bfa3-709f75a0f89c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 14:12:24.191630 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5581d2f1c9c0 pid: 103151 (default app) Jun 07 14:12:24.193025 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: WARNING keystonemiddleware.auth_token [None req-16e77b39-bed7-49a3-9dc4-45d21ffb7691 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 14:12:24.195025 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-5a2b0c2d-df15-4aad-bfa3-709f75a0f89c None None] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:12:24.196230 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-5a2b0c2d-df15-4aad-bfa3-709f75a0f89c None None] 10.222.0.81 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003046 Jun 07 14:12:24.196644 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 1/1] 10.222.0.81 () {50 vars in 788 bytes} [Tue Jun 7 14:12:24 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:12:24.199008 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: WARNING keystonemiddleware.auth_token [None req-16e77b39-bed7-49a3-9dc4-45d21ffb7691 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 14:12:24.204884 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5581d2f1c9c0 pid: 103152 (default app) Jun 07 14:13:43.765934 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-5a2b0c2d-df15-4aad-bfa3-709f75a0f89c None None] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:13:43.766935 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-5a2b0c2d-df15-4aad-bfa3-709f75a0f89c None None] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jun 07 14:13:43.767657 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 2/2] 10.222.0.81 () {54 vars in 930 bytes} [Tue Jun 7 14:13:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:13:43.784551 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG dbcounter [-] [103152] Writing DB stats nova_api:SELECT=3 {{(pid=103152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:43.785489 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG dbcounter [-] [103152] Writing DB stats nova_cell0:SELECT=3 {{(pid=103152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:43.786726 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG dbcounter [-] [103152] Writing DB stats nova_cell1:SELECT=3 {{(pid=103152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:43.787589 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG dbcounter [-] [103152] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:44.224525 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-97b35fef-b4d1-402f-a1ad-7698ce09e3a4 admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:13:44.255420 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-97b35fef-b4d1-402f-a1ad-7698ce09e3a4 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.479823 Jun 07 14:13:44.258240 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 1/3] 10.222.0.81 () {60 vars in 1291 bytes} [Tue Jun 7 14:13:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:13:46.590625 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-5a2b0c2d-df15-4aad-bfa3-709f75a0f89c None None] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:13:46.591657 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-5a2b0c2d-df15-4aad-bfa3-709f75a0f89c None None] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 07 14:13:46.592242 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 3/4] 10.222.0.81 () {54 vars in 930 bytes} [Tue Jun 7 14:13:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:13:46.652600 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-3f6f429f-343a-43db-ae4c-804c8c9271a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 256, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:13:46.670988 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:13:46.670988 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: warnings.warn(msg) Jun 07 14:13:46.699822 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-3f6f429f-343a-43db-ae4c-804c8c9271a5 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.101761 Jun 07 14:13:46.700560 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 2/5] 10.222.0.81 () {64 vars in 1282 bytes} [Tue Jun 7 14:13:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:13:46.919613 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-efc207ab-04d8-41cd-9cef-5518d7e78cc2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:13:46.922041 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:13:46.922041 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: warnings.warn(msg) Jun 07 14:13:46.924731 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_api:SELECT=3 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:46.925528 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_cell0:SELECT=3 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:46.926662 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_cell1:SELECT=3 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:46.927379 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:46.989858 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-efc207ab-04d8-41cd-9cef-5518d7e78cc2 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281298 Jun 07 14:13:46.990441 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 4/6] 10.222.0.81 () {64 vars in 1335 bytes} [Tue Jun 7 14:13:46 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:13:49.320975 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-3f6f429f-343a-43db-ae4c-804c8c9271a5 admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:13:49.322276 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-3f6f429f-343a-43db-ae4c-804c8c9271a5 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001801 Jun 07 14:13:49.322678 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 3/7] 10.222.0.81 () {54 vars in 930 bytes} [Tue Jun 7 14:13:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:13:49.442977 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-2126d738-4eca-4da7-a77a-f2d96b445ade admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "disk": 5, "swap": 0, "rxtx_factor": 1.0, "id": "d1", "name": "ds512M", "vcpus": 1}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:13:49.460707 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:13:49.460707 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: warnings.warn(msg) Jun 07 14:13:49.480926 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-2126d738-4eca-4da7-a77a-f2d96b445ade admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.152472 Jun 07 14:13:49.481477 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 5/8] 10.222.0.81 () {64 vars in 1282 bytes} [Tue Jun 7 14:13:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:13:49.493991 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-17d89b55-e2ca-4b3d-8942-a40735c8bd79 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:13:49.495528 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:13:49.495528 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: warnings.warn(msg) Jun 07 14:13:49.530200 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-17d89b55-e2ca-4b3d-8942-a40735c8bd79 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040028 Jun 07 14:13:49.530864 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 4/9] 10.222.0.81 () {64 vars in 1335 bytes} [Tue Jun 7 14:13:49 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:13:51.845415 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-2126d738-4eca-4da7-a77a-f2d96b445ade admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:13:51.846435 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-2126d738-4eca-4da7-a77a-f2d96b445ade admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 07 14:13:51.846849 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 6/10] 10.222.0.81 () {54 vars in 930 bytes} [Tue Jun 7 14:13:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:13:51.907787 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-f58868d4-61c9-40e4-bf79-2653c38b2251 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "os-flavor-access:is_public": true, "disk": 10, "swap": 0, "ram": 1024, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:13:51.927546 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-f58868d4-61c9-40e4-bf79-2653c38b2251 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073801 Jun 07 14:13:51.928379 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 5/11] 10.222.0.81 () {64 vars in 1282 bytes} [Tue Jun 7 14:13:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:13:51.940328 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-b1a6e8f1-c0e2-44c5-b25b-9fdf990f9118 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:13:51.965173 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-b1a6e8f1-c0e2-44c5-b25b-9fdf990f9118 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028547 Jun 07 14:13:51.966068 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 7/12] 10.222.0.81 () {64 vars in 1335 bytes} [Tue Jun 7 14:13:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:13:54.344185 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-f58868d4-61c9-40e4-bf79-2653c38b2251 admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:13:54.345241 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-f58868d4-61c9-40e4-bf79-2653c38b2251 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jun 07 14:13:54.345649 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 6/13] 10.222.0.81 () {54 vars in 930 bytes} [Tue Jun 7 14:13:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:13:54.413410 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-9fd29195-85b8-4bda-8552-b613db29549c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "ds2G", "id": "d3", "swap": 0, "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:13:54.433973 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-9fd29195-85b8-4bda-8552-b613db29549c admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078311 Jun 07 14:13:54.434456 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 8/14] 10.222.0.81 () {64 vars in 1282 bytes} [Tue Jun 7 14:13:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:13:54.446867 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-fdf6de1c-ddc0-47a8-b343-f569ad1969bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:13:54.472912 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-fdf6de1c-ddc0-47a8-b343-f569ad1969bb admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030151 Jun 07 14:13:54.473511 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 7/15] 10.222.0.81 () {64 vars in 1335 bytes} [Tue Jun 7 14:13:54 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:13:56.821841 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-9fd29195-85b8-4bda-8552-b613db29549c admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:13:56.822853 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-9fd29195-85b8-4bda-8552-b613db29549c admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Jun 07 14:13:56.823276 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 9/16] 10.222.0.81 () {54 vars in 930 bytes} [Tue Jun 7 14:13:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:13:56.885353 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-d3e8e85e-86fa-4898-9af4-64000c3c8002 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 4096, "name": "ds4G", "disk": 20, "swap": 0}} {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:13:56.903868 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-d3e8e85e-86fa-4898-9af4-64000c3c8002 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074371 Jun 07 14:13:56.904430 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 8/17] 10.222.0.81 () {64 vars in 1282 bytes} [Tue Jun 7 14:13:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 14:13:56.916558 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-0b18f7ee-c609-4ecf-91b8-4f522bf1fb47 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:13:56.940153 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-0b18f7ee-c609-4ecf-91b8-4f522bf1fb47 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027412 Jun 07 14:13:56.941181 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 10/18] 10.222.0.81 () {64 vars in 1335 bytes} [Tue Jun 7 14:13:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:13:59.271663 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-d3e8e85e-86fa-4898-9af4-64000c3c8002 admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:13:59.272725 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-d3e8e85e-86fa-4898-9af4-64000c3c8002 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001626 Jun 07 14:13:59.279342 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 9/19] 10.222.0.81 () {54 vars in 930 bytes} [Tue Jun 7 14:13:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:13:59.335909 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-e84b0010-6a03-4b0c-830f-fdd3093dea91 admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:13:59.360253 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-e84b0010-6a03-4b0c-830f-fdd3093dea91 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078778 Jun 07 14:13:59.360995 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 11/20] 10.222.0.81 () {60 vars in 1291 bytes} [Tue Jun 7 14:13:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:14:01.704251 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-d3e8e85e-86fa-4898-9af4-64000c3c8002 admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:01.706176 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-d3e8e85e-86fa-4898-9af4-64000c3c8002 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002915 Jun 07 14:14:01.706951 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 10/21] 10.222.0.81 () {54 vars in 930 bytes} [Tue Jun 7 14:14:01 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:14:01.777897 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-0eadeb40-dec9-4b12-a848-8be3f201cd8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "disk": 1, "id": "1"}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:14:01.796784 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-0eadeb40-dec9-4b12-a848-8be3f201cd8d admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.082622 Jun 07 14:14:01.797361 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 12/22] 10.222.0.81 () {64 vars in 1282 bytes} [Tue Jun 7 14:14:01 2022] POST /compute/v2.1/flavors => generated 402 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:14:01.810736 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-658716bc-c3f5-4745-83db-146560de1da0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:14:01.840984 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-658716bc-c3f5-4745-83db-146560de1da0 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034874 Jun 07 14:14:01.841930 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 11/23] 10.222.0.81 () {64 vars in 1332 bytes} [Tue Jun 7 14:14:01 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:14:04.161242 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-0eadeb40-dec9-4b12-a848-8be3f201cd8d admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:04.163362 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-0eadeb40-dec9-4b12-a848-8be3f201cd8d admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002107 Jun 07 14:14:04.163806 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 13/24] 10.222.0.81 () {54 vars in 930 bytes} [Tue Jun 7 14:14:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:14:04.242464 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-c618b576-30a8-4f1a-945d-9933f31ce0d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "ram": 2048, "rxtx_factor": 1.0, "id": "2", "name": "m1.small"}} {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:14:04.267342 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-c618b576-30a8-4f1a-945d-9933f31ce0d7 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.094952 Jun 07 14:14:04.268307 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 12/25] 10.222.0.81 () {64 vars in 1282 bytes} [Tue Jun 7 14:14:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:14:04.281125 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-169066ce-ea81-4148-afa7-09515e075852 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:14:04.303458 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-169066ce-ea81-4148-afa7-09515e075852 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025984 Jun 07 14:14:04.304045 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 14/26] 10.222.0.81 () {64 vars in 1332 bytes} [Tue Jun 7 14:14:04 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:14:06.883492 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-c618b576-30a8-4f1a-945d-9933f31ce0d7 admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:06.884509 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-c618b576-30a8-4f1a-945d-9933f31ce0d7 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002066 Jun 07 14:14:06.885088 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 13/27] 10.222.0.81 () {54 vars in 930 bytes} [Tue Jun 7 14:14:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:14:06.945113 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-a85ed828-87a5-45fd-b6c0-83c3cc483c80 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "vcpus": 2, "id": "3"}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:14:06.963832 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-a85ed828-87a5-45fd-b6c0-83c3cc483c80 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072607 Jun 07 14:14:06.964400 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 15/28] 10.222.0.81 () {64 vars in 1282 bytes} [Tue Jun 7 14:14:06 2022] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 14:14:06.976125 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-0c7aa096-7078-47a5-af43-ec0325f8121c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:14:06.998679 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-0c7aa096-7078-47a5-af43-ec0325f8121c admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026212 Jun 07 14:14:06.999436 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 14/29] 10.222.0.81 () {64 vars in 1332 bytes} [Tue Jun 7 14:14:06 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:14:09.344931 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-a85ed828-87a5-45fd-b6c0-83c3cc483c80 admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:09.345974 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-a85ed828-87a5-45fd-b6c0-83c3cc483c80 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Jun 07 14:14:09.346445 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 16/30] 10.222.0.81 () {54 vars in 930 bytes} [Tue Jun 7 14:14:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:14:09.411453 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-1f65dcdf-e42a-4849-af01-b297fd0efb22 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "disk": 80, "ram": 8192, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:14:09.433125 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-1f65dcdf-e42a-4849-af01-b297fd0efb22 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.080066 Jun 07 14:14:09.434152 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 15/31] 10.222.0.81 () {64 vars in 1282 bytes} [Tue Jun 7 14:14:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 14:14:09.446593 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-cb3b4f66-f1dd-47ab-a53b-d57b0a766572 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:14:09.471056 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-cb3b4f66-f1dd-47ab-a53b-d57b0a766572 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028989 Jun 07 14:14:09.471659 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 17/32] 10.222.0.81 () {64 vars in 1332 bytes} [Tue Jun 7 14:14:09 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:14:11.810298 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-1f65dcdf-e42a-4849-af01-b297fd0efb22 admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:11.812111 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-1f65dcdf-e42a-4849-af01-b297fd0efb22 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002259 Jun 07 14:14:11.812921 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 16/33] 10.222.0.81 () {54 vars in 930 bytes} [Tue Jun 7 14:14:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:14:11.877981 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-d1ef44df-3bff-4e98-b48f-f7d821b2fe0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "id": "5", "swap": 0}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:14:11.896824 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-d1ef44df-3bff-4e98-b48f-f7d821b2fe0e admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077780 Jun 07 14:14:11.897705 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 18/34] 10.222.0.81 () {64 vars in 1282 bytes} [Tue Jun 7 14:14:11 2022] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:14:11.911339 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-f700c33a-9cb1-4665-ab6b-b23161639157 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:14:11.943262 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-f700c33a-9cb1-4665-ab6b-b23161639157 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037507 Jun 07 14:14:11.944659 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 17/35] 10.222.0.81 () {64 vars in 1332 bytes} [Tue Jun 7 14:14:11 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:14:36.460257 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-d1ef44df-3bff-4e98-b48f-f7d821b2fe0e admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:36.461266 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-d1ef44df-3bff-4e98-b48f-f7d821b2fe0e admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jun 07 14:14:36.461664 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 19/36] 10.222.0.81 () {54 vars in 930 bytes} [Tue Jun 7 14:14:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:14:36.472135 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG dbcounter [-] [103152] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:14:36.522599 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-430f5c9e-b22c-4c8e-8484-1f3b766343a7 admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:36.541019 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-430f5c9e-b22c-4c8e-8484-1f3b766343a7 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073404 Jun 07 14:14:36.541555 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 18/37] 10.222.0.81 () {60 vars in 1291 bytes} [Tue Jun 7 14:14:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:14:37.539285 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-d1ef44df-3bff-4e98-b48f-f7d821b2fe0e admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:37.540325 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-d1ef44df-3bff-4e98-b48f-f7d821b2fe0e admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jun 07 14:14:37.540718 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 20/38] 10.222.0.81 () {56 vars in 1074 bytes} [Tue Jun 7 14:14:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:14:37.751018 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-cee53dad-6bf4-4d0a-a246-b3070ba4d670 admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:37.756668 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.wsgi [None req-cee53dad-6bf4-4d0a-a246-b3070ba4d670 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 07 14:14:37.759941 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-cee53dad-6bf4-4d0a-a246-b3070ba4d670 admin admin] Request method failure captured: Jun 07 14:14:37.759941 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 07 14:14:37.759941 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: Accept: application/json Jun 07 14:14:37.759941 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: Accept-Encoding: gzip, deflate Jun 07 14:14:37.759941 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: Connection: keep-alive Jun 07 14:14:37.759941 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: Content-Length: 0 Jun 07 14:14:37.759941 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: Host: 10.222.0.81 Jun 07 14:14:37.759941 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: Openstack-Api-Version: compute 2.90 Jun 07 14:14:37.759941 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: Openstack-System-Scope: None Jun 07 14:14:37.759941 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: User-Agent: python-novaclient Jun 07 14:14:37.759941 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Auth-Token: gAAAAABin11NXWIn5JGkh7KUKphh1c8SIps9IuD7FgRcrrw12pThJGl3GbmBvveMJOEpjcmp2RodDo8bfAillarJPIzq8wUIt8eBsq25j6CzsrZUU3f-jQ-4JpthZQ_uk8GvWHt4ehAOZrgx6eMkiJOXuZQZFTjFeGtu9GzshIrz0j9RLIWJLpY Jun 07 14:14:37.759941 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Domain-Id: None Jun 07 14:14:37.759941 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Domain-Name: None Jun 07 14:14:37.759941 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Identity-Status: Confirmed Jun 07 14:14:37.759941 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Is-Admin-Project: True Jun 07 14:14:37.759941 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 14:14:37.759941 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Project-Domain-Id: default Jun 07 14:14:37.759941 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Project-Domain-Name: Default Jun 07 14:14:37.759941 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Project-Id: 50e31e6b5bc94b188158e931e4ee4076 Jun 07 14:14:37.759941 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Project-Name: admin Jun 07 14:14:37.759941 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Role: member,reader,admin Jun 07 14:14:37.759941 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Roles: member,reader,admin Jun 07 14:14:37.761635 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/50e31e6b5bc94b188158e931e4ee4076"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_50e31e6b5bc94b188158e931e4ee4076", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/50e31e6b5bc94b188158e931e4ee4076"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/50e31e6b5bc94b188158e931e4ee4076"}]}] Jun 07 14:14:37.761635 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Tenant: admin Jun 07 14:14:37.761635 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Tenant-Id: 50e31e6b5bc94b188158e931e4ee4076 Jun 07 14:14:37.761635 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Tenant-Name: admin Jun 07 14:14:37.761635 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-User: admin Jun 07 14:14:37.761635 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-User-Domain-Id: default Jun 07 14:14:37.761635 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-User-Domain-Name: Default Jun 07 14:14:37.761635 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-User-Id: 2604a49f226a4bdf958c4047caf193e8 Jun 07 14:14:37.761635 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-User-Name: admin Jun 07 14:14:37.761635 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: method: > Jun 07 14:14:37.761635 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: exception: Flavor 42 could not be found. Jun 07 14:14:37.761635 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: action_args: {'id': '42'} Jun 07 14:14:37.761635 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:14:37.761635 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:14:37.762579 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 14:14:37.762579 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 14:14:37.762579 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 14:14:37.762579 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 14:14:37.762579 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 14:14:37.762579 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 14:14:37.762579 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 14:14:37.762579 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 14:14:37.762579 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 14:14:37.762579 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:14:37.762579 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 14:14:37.762579 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 14:14:37.762579 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 07 14:14:37.762579 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi Jun 07 14:14:37.762579 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:14:37.762579 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi Jun 07 14:14:37.762579 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:14:37.762579 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:14:37.762579 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:14:37.763867 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:14:37.763867 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:14:37.763867 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:14:37.763867 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:14:37.763867 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 14:14:37.763867 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:14:37.763867 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 07 14:14:37.763867 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi Jun 07 14:14:37.763867 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:14:37.763867 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi Jun 07 14:14:37.763867 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:14:37.763867 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:14:37.763867 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:14:37.763867 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:14:37.763867 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:14:37.763867 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 07 14:14:37.763867 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi Jun 07 14:14:37.763867 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-cee53dad-6bf4-4d0a-a246-b3070ba4d670 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:14:37.764949 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-cee53dad-6bf4-4d0a-a246-b3070ba4d670 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062543 Jun 07 14:14:37.764949 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 19/39] 10.222.0.81 () {60 vars in 1190 bytes} [Tue Jun 7 14:14:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 14:14:37.771138 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-f50e34f1-485b-415c-b9fc-00860068b462 admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:37.774178 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:14:37.794653 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-f50e34f1-485b-415c-b9fc-00860068b462 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027016 Jun 07 14:14:37.795207 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 21/40] 10.222.0.81 () {60 vars in 1210 bytes} [Tue Jun 7 14:14:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:14:37.805737 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-7d4c882a-bb07-44a6-b4b0-4d317bf66c90 admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:37.827489 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-7d4c882a-bb07-44a6-b4b0-4d317bf66c90 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025934 Jun 07 14:14:37.828026 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 20/41] 10.222.0.81 () {60 vars in 1210 bytes} [Tue Jun 7 14:14:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:14:37.837484 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-9d3726bf-865f-4c8b-a117-8bb0024471be admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:37.843763 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.wsgi [None req-9d3726bf-865f-4c8b-a117-8bb0024471be admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 07 14:14:37.846967 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-9d3726bf-865f-4c8b-a117-8bb0024471be admin admin] Request method failure captured: Jun 07 14:14:37.846967 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 07 14:14:37.846967 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: Accept: application/json Jun 07 14:14:37.846967 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: Accept-Encoding: gzip, deflate Jun 07 14:14:37.846967 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: Connection: keep-alive Jun 07 14:14:37.846967 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: Content-Length: 0 Jun 07 14:14:37.846967 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: Host: 10.222.0.81 Jun 07 14:14:37.846967 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: Openstack-Api-Version: compute 2.90 Jun 07 14:14:37.846967 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: Openstack-System-Scope: None Jun 07 14:14:37.846967 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: User-Agent: python-novaclient Jun 07 14:14:37.846967 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Auth-Token: gAAAAABin11NXWIn5JGkh7KUKphh1c8SIps9IuD7FgRcrrw12pThJGl3GbmBvveMJOEpjcmp2RodDo8bfAillarJPIzq8wUIt8eBsq25j6CzsrZUU3f-jQ-4JpthZQ_uk8GvWHt4ehAOZrgx6eMkiJOXuZQZFTjFeGtu9GzshIrz0j9RLIWJLpY Jun 07 14:14:37.846967 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Domain-Id: None Jun 07 14:14:37.846967 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Domain-Name: None Jun 07 14:14:37.846967 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Identity-Status: Confirmed Jun 07 14:14:37.846967 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Is-Admin-Project: True Jun 07 14:14:37.846967 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 14:14:37.846967 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Project-Domain-Id: default Jun 07 14:14:37.846967 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Project-Domain-Name: Default Jun 07 14:14:37.846967 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Project-Id: 50e31e6b5bc94b188158e931e4ee4076 Jun 07 14:14:37.846967 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Project-Name: admin Jun 07 14:14:37.846967 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Role: member,reader,admin Jun 07 14:14:37.846967 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Roles: member,reader,admin Jun 07 14:14:37.849361 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/50e31e6b5bc94b188158e931e4ee4076"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_50e31e6b5bc94b188158e931e4ee4076", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/50e31e6b5bc94b188158e931e4ee4076"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/50e31e6b5bc94b188158e931e4ee4076"}]}] Jun 07 14:14:37.849361 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Tenant: admin Jun 07 14:14:37.849361 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Tenant-Id: 50e31e6b5bc94b188158e931e4ee4076 Jun 07 14:14:37.849361 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Tenant-Name: admin Jun 07 14:14:37.849361 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-User: admin Jun 07 14:14:37.849361 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-User-Domain-Id: default Jun 07 14:14:37.849361 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-User-Domain-Name: Default Jun 07 14:14:37.849361 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-User-Id: 2604a49f226a4bdf958c4047caf193e8 Jun 07 14:14:37.849361 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-User-Name: admin Jun 07 14:14:37.849361 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: method: > Jun 07 14:14:37.849361 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: exception: Flavor 42 could not be found. Jun 07 14:14:37.849361 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: action_args: {'id': '42'} Jun 07 14:14:37.849361 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:14:37.849361 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:14:37.851719 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 14:14:37.851719 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 14:14:37.851719 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 14:14:37.851719 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 14:14:37.851719 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 14:14:37.851719 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 14:14:37.851719 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 14:14:37.851719 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 14:14:37.851719 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 14:14:37.851719 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:14:37.851719 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 14:14:37.851719 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 14:14:37.851719 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 07 14:14:37.851719 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 07 14:14:37.851719 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:14:37.851719 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 07 14:14:37.851719 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:14:37.851719 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:14:37.851719 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:14:37.853803 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:14:37.853803 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:14:37.853803 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:14:37.853803 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:14:37.853803 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 14:14:37.853803 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:14:37.853803 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 07 14:14:37.853803 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 07 14:14:37.853803 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:14:37.853803 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 07 14:14:37.853803 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:14:37.853803 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:14:37.853803 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:14:37.853803 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:14:37.853803 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:14:37.853803 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 07 14:14:37.853803 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 07 14:14:37.853803 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-9d3726bf-865f-4c8b-a117-8bb0024471be admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:14:37.855679 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-9d3726bf-865f-4c8b-a117-8bb0024471be admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014844 Jun 07 14:14:37.855679 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 22/42] 10.222.0.81 () {60 vars in 1190 bytes} [Tue Jun 7 14:14:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 14:14:38.718645 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-7d4c882a-bb07-44a6-b4b0-4d317bf66c90 admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:38.719680 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-7d4c882a-bb07-44a6-b4b0-4d317bf66c90 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 07 14:14:38.720073 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 21/43] 10.222.0.81 () {56 vars in 1074 bytes} [Tue Jun 7 14:14:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:14:38.908378 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-5e20927e-68ee-4d35-9940-65b5fc2b5d2d admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:38.914593 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.wsgi [None req-5e20927e-68ee-4d35-9940-65b5fc2b5d2d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 07 14:14:38.916127 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-5e20927e-68ee-4d35-9940-65b5fc2b5d2d admin admin] Request method failure captured: Jun 07 14:14:38.916127 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 07 14:14:38.916127 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: Accept: application/json Jun 07 14:14:38.916127 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: Accept-Encoding: gzip, deflate Jun 07 14:14:38.916127 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: Connection: keep-alive Jun 07 14:14:38.916127 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: Content-Length: 0 Jun 07 14:14:38.916127 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: Host: 10.222.0.81 Jun 07 14:14:38.916127 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: Openstack-Api-Version: compute 2.90 Jun 07 14:14:38.916127 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: Openstack-System-Scope: None Jun 07 14:14:38.916127 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: User-Agent: python-novaclient Jun 07 14:14:38.916127 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Auth-Token: gAAAAABin11O17UF-VwQMI0gT_u38g6AKVhfxQISKoa4smbb1D2_H8tmhOBSIUKEjs6lEJ54Vsi835GmsWssMMJW1wYRMEnZyMEeUDqVNYnWxRZT9Tq9yOE5ENte-MwOWhoAT-jIGPlEvgjP-e6HAItf4-3qnMWwQnVFnK5t3t932h1Z4syOYr0 Jun 07 14:14:38.916127 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Domain-Id: None Jun 07 14:14:38.916127 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Domain-Name: None Jun 07 14:14:38.916127 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Identity-Status: Confirmed Jun 07 14:14:38.916127 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Is-Admin-Project: True Jun 07 14:14:38.916127 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 14:14:38.916127 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Project-Domain-Id: default Jun 07 14:14:38.916127 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Project-Domain-Name: Default Jun 07 14:14:38.916127 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Project-Id: 50e31e6b5bc94b188158e931e4ee4076 Jun 07 14:14:38.916127 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Project-Name: admin Jun 07 14:14:38.916127 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Role: member,reader,admin Jun 07 14:14:38.916127 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Roles: member,reader,admin Jun 07 14:14:38.917688 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/50e31e6b5bc94b188158e931e4ee4076"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_50e31e6b5bc94b188158e931e4ee4076", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/50e31e6b5bc94b188158e931e4ee4076"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/50e31e6b5bc94b188158e931e4ee4076"}]}] Jun 07 14:14:38.917688 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Tenant: admin Jun 07 14:14:38.917688 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Tenant-Id: 50e31e6b5bc94b188158e931e4ee4076 Jun 07 14:14:38.917688 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Tenant-Name: admin Jun 07 14:14:38.917688 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-User: admin Jun 07 14:14:38.917688 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-User-Domain-Id: default Jun 07 14:14:38.917688 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-User-Domain-Name: Default Jun 07 14:14:38.917688 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-User-Id: 2604a49f226a4bdf958c4047caf193e8 Jun 07 14:14:38.917688 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-User-Name: admin Jun 07 14:14:38.917688 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: method: > Jun 07 14:14:38.917688 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: exception: Flavor 84 could not be found. Jun 07 14:14:38.917688 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: action_args: {'id': '84'} Jun 07 14:14:38.917688 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:14:38.917688 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:14:38.918661 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 14:14:38.918661 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 14:14:38.918661 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 14:14:38.918661 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 14:14:38.918661 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 14:14:38.918661 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 14:14:38.918661 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 14:14:38.918661 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 14:14:38.918661 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 14:14:38.918661 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:14:38.918661 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 14:14:38.918661 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 14:14:38.918661 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 07 14:14:38.918661 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 07 14:14:38.918661 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:14:38.918661 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 07 14:14:38.918661 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:14:38.918661 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:14:38.918661 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:14:38.919989 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:14:38.919989 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:14:38.919989 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:14:38.919989 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:14:38.919989 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 14:14:38.919989 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:14:38.919989 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 07 14:14:38.919989 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 07 14:14:38.919989 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:14:38.919989 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 07 14:14:38.919989 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:14:38.919989 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:14:38.919989 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:14:38.919989 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:14:38.919989 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:14:38.919989 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 07 14:14:38.919989 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 07 14:14:38.919989 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-5e20927e-68ee-4d35-9940-65b5fc2b5d2d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:14:38.921240 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-5e20927e-68ee-4d35-9940-65b5fc2b5d2d admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061832 Jun 07 14:14:38.921240 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 23/44] 10.222.0.81 () {60 vars in 1190 bytes} [Tue Jun 7 14:14:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 14:14:38.927400 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-0c996dd8-8eea-4130-a789-32baeb2c86eb admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:38.941570 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-0c996dd8-8eea-4130-a789-32baeb2c86eb admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017808 Jun 07 14:14:38.942051 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 22/45] 10.222.0.81 () {60 vars in 1210 bytes} [Tue Jun 7 14:14:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:14:38.951782 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-78825f3d-23b0-4897-8c52-6a30dd6d9e82 admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:38.965303 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-78825f3d-23b0-4897-8c52-6a30dd6d9e82 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016979 Jun 07 14:14:38.965857 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 24/46] 10.222.0.81 () {60 vars in 1210 bytes} [Tue Jun 7 14:14:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:14:38.974679 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-ab80ae98-5720-4d8f-a1cd-f8399e4dc0ad admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:38.980237 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.wsgi [None req-ab80ae98-5720-4d8f-a1cd-f8399e4dc0ad admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 07 14:14:38.981725 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-ab80ae98-5720-4d8f-a1cd-f8399e4dc0ad admin admin] Request method failure captured: Jun 07 14:14:38.981725 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 07 14:14:38.981725 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: Accept: application/json Jun 07 14:14:38.981725 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: Accept-Encoding: gzip, deflate Jun 07 14:14:38.981725 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: Connection: keep-alive Jun 07 14:14:38.981725 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: Content-Length: 0 Jun 07 14:14:38.981725 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: Host: 10.222.0.81 Jun 07 14:14:38.981725 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: Openstack-Api-Version: compute 2.90 Jun 07 14:14:38.981725 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: Openstack-System-Scope: None Jun 07 14:14:38.981725 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: User-Agent: python-novaclient Jun 07 14:14:38.981725 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Auth-Token: gAAAAABin11O17UF-VwQMI0gT_u38g6AKVhfxQISKoa4smbb1D2_H8tmhOBSIUKEjs6lEJ54Vsi835GmsWssMMJW1wYRMEnZyMEeUDqVNYnWxRZT9Tq9yOE5ENte-MwOWhoAT-jIGPlEvgjP-e6HAItf4-3qnMWwQnVFnK5t3t932h1Z4syOYr0 Jun 07 14:14:38.981725 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Domain-Id: None Jun 07 14:14:38.981725 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Domain-Name: None Jun 07 14:14:38.981725 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Identity-Status: Confirmed Jun 07 14:14:38.981725 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Is-Admin-Project: True Jun 07 14:14:38.981725 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 14:14:38.981725 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Project-Domain-Id: default Jun 07 14:14:38.981725 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Project-Domain-Name: Default Jun 07 14:14:38.981725 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Project-Id: 50e31e6b5bc94b188158e931e4ee4076 Jun 07 14:14:38.981725 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Project-Name: admin Jun 07 14:14:38.981725 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Role: member,reader,admin Jun 07 14:14:38.981725 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Roles: member,reader,admin Jun 07 14:14:38.983272 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/50e31e6b5bc94b188158e931e4ee4076"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_50e31e6b5bc94b188158e931e4ee4076", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/50e31e6b5bc94b188158e931e4ee4076"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/50e31e6b5bc94b188158e931e4ee4076"}]}] Jun 07 14:14:38.983272 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Tenant: admin Jun 07 14:14:38.983272 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Tenant-Id: 50e31e6b5bc94b188158e931e4ee4076 Jun 07 14:14:38.983272 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Tenant-Name: admin Jun 07 14:14:38.983272 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-User: admin Jun 07 14:14:38.983272 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-User-Domain-Id: default Jun 07 14:14:38.983272 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-User-Domain-Name: Default Jun 07 14:14:38.983272 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-User-Id: 2604a49f226a4bdf958c4047caf193e8 Jun 07 14:14:38.983272 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-User-Name: admin Jun 07 14:14:38.983272 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: method: > Jun 07 14:14:38.983272 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: exception: Flavor 84 could not be found. Jun 07 14:14:38.983272 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: action_args: {'id': '84'} Jun 07 14:14:38.983272 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:14:38.983272 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:14:38.984227 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 14:14:38.984227 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 14:14:38.984227 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 14:14:38.984227 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 14:14:38.984227 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 14:14:38.984227 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 14:14:38.984227 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 14:14:38.984227 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 14:14:38.984227 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 14:14:38.984227 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:14:38.984227 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 14:14:38.984227 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 14:14:38.984227 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 07 14:14:38.984227 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi Jun 07 14:14:38.984227 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:14:38.984227 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi Jun 07 14:14:38.984227 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:14:38.984227 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:14:38.984227 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:14:38.985668 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:14:38.985668 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:14:38.985668 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:14:38.985668 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:14:38.985668 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 14:14:38.985668 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:14:38.985668 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 07 14:14:38.985668 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi Jun 07 14:14:38.985668 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:14:38.985668 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi Jun 07 14:14:38.985668 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:14:38.985668 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:14:38.985668 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:14:38.985668 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:14:38.985668 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:14:38.985668 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 07 14:14:38.985668 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi Jun 07 14:14:38.985668 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-ab80ae98-5720-4d8f-a1cd-f8399e4dc0ad admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:14:38.987328 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-ab80ae98-5720-4d8f-a1cd-f8399e4dc0ad admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011888 Jun 07 14:14:38.987328 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 23/47] 10.222.0.81 () {60 vars in 1190 bytes} [Tue Jun 7 14:14:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 07 14:14:39.848530 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-78825f3d-23b0-4897-8c52-6a30dd6d9e82 admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:39.849537 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-78825f3d-23b0-4897-8c52-6a30dd6d9e82 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 07 14:14:39.849935 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 25/48] 10.222.0.81 () {56 vars in 1074 bytes} [Tue Jun 7 14:14:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:14:40.038587 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-d971bc8a-5561-4007-9a66-f533fbe487a7 admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:40.044393 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.wsgi [None req-d971bc8a-5561-4007-9a66-f533fbe487a7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 07 14:14:40.045885 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-d971bc8a-5561-4007-9a66-f533fbe487a7 admin admin] Request method failure captured: Jun 07 14:14:40.045885 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 07 14:14:40.045885 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: Accept: application/json Jun 07 14:14:40.045885 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: Accept-Encoding: gzip, deflate Jun 07 14:14:40.045885 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: Connection: keep-alive Jun 07 14:14:40.045885 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: Content-Length: 0 Jun 07 14:14:40.045885 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: Host: 10.222.0.81 Jun 07 14:14:40.045885 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: Openstack-Api-Version: compute 2.90 Jun 07 14:14:40.045885 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: Openstack-System-Scope: None Jun 07 14:14:40.045885 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: User-Agent: python-novaclient Jun 07 14:14:40.045885 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Auth-Token: gAAAAABin11P6rviJluK5iOfehP74d6GrmWO-dVt33Tes664ph5rl2mp3zJDRFndMZ6nFTbwUFRvFI16OXQTn1xv2C9T4VUXrBrJo-5J5w85p8M-Vxqz1ItGwPHmuDb3d2-u4XTvF5p1phVXUD-GfYBIXWyw--4pG2ZrnFNm2TaUoZjZQRSz2yc Jun 07 14:14:40.045885 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Domain-Id: None Jun 07 14:14:40.045885 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Domain-Name: None Jun 07 14:14:40.045885 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Identity-Status: Confirmed Jun 07 14:14:40.045885 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Is-Admin-Project: True Jun 07 14:14:40.045885 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 14:14:40.045885 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Project-Domain-Id: default Jun 07 14:14:40.045885 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Project-Domain-Name: Default Jun 07 14:14:40.045885 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Project-Id: 50e31e6b5bc94b188158e931e4ee4076 Jun 07 14:14:40.045885 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Project-Name: admin Jun 07 14:14:40.045885 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Role: member,reader,admin Jun 07 14:14:40.045885 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Roles: member,reader,admin Jun 07 14:14:40.047263 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/50e31e6b5bc94b188158e931e4ee4076"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_50e31e6b5bc94b188158e931e4ee4076", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/50e31e6b5bc94b188158e931e4ee4076"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/50e31e6b5bc94b188158e931e4ee4076"}]}] Jun 07 14:14:40.047263 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Tenant: admin Jun 07 14:14:40.047263 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Tenant-Id: 50e31e6b5bc94b188158e931e4ee4076 Jun 07 14:14:40.047263 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-Tenant-Name: admin Jun 07 14:14:40.047263 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-User: admin Jun 07 14:14:40.047263 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-User-Domain-Id: default Jun 07 14:14:40.047263 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-User-Domain-Name: Default Jun 07 14:14:40.047263 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-User-Id: 2604a49f226a4bdf958c4047caf193e8 Jun 07 14:14:40.047263 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: X-User-Name: admin Jun 07 14:14:40.047263 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: method: > Jun 07 14:14:40.047263 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: exception: Flavor 451 could not be found. Jun 07 14:14:40.047263 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: action_args: {'id': '451'} Jun 07 14:14:40.047263 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:14:40.047263 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:14:40.048213 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 14:14:40.048213 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 14:14:40.048213 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 14:14:40.048213 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 14:14:40.048213 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 14:14:40.048213 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 14:14:40.048213 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 14:14:40.048213 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 14:14:40.048213 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 14:14:40.048213 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:14:40.048213 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 14:14:40.048213 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 14:14:40.048213 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 07 14:14:40.048213 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi Jun 07 14:14:40.048213 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:14:40.048213 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi Jun 07 14:14:40.048213 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:14:40.048213 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:14:40.048213 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:14:40.049780 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:14:40.049780 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:14:40.049780 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:14:40.049780 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:14:40.049780 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 14:14:40.049780 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:14:40.049780 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 07 14:14:40.049780 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi Jun 07 14:14:40.049780 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:14:40.049780 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi Jun 07 14:14:40.049780 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:14:40.049780 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:14:40.049780 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:14:40.049780 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:14:40.049780 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:14:40.049780 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 07 14:14:40.049780 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: ERROR nova.api.openstack.wsgi Jun 07 14:14:40.049780 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-d971bc8a-5561-4007-9a66-f533fbe487a7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:14:40.051059 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-d971bc8a-5561-4007-9a66-f533fbe487a7 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060259 Jun 07 14:14:40.051059 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 24/49] 10.222.0.81 () {60 vars in 1193 bytes} [Tue Jun 7 14:14:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 14:14:40.056998 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-ff8be8fc-5ab0-4360-8889-442f7a39d99a admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:40.071175 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-ff8be8fc-5ab0-4360-8889-442f7a39d99a admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017790 Jun 07 14:14:40.071664 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 26/50] 10.222.0.81 () {60 vars in 1210 bytes} [Tue Jun 7 14:14:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:14:40.080746 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-db19a19a-19a9-4cd2-a090-0efdcc818237 admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:40.095103 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-db19a19a-19a9-4cd2-a090-0efdcc818237 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017881 Jun 07 14:14:40.095677 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 25/51] 10.222.0.81 () {60 vars in 1210 bytes} [Tue Jun 7 14:14:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:14:40.104945 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-92de533c-58cc-4267-9b07-7b132fb10399 admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:40.110278 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.wsgi [None req-92de533c-58cc-4267-9b07-7b132fb10399 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 07 14:14:40.112049 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-92de533c-58cc-4267-9b07-7b132fb10399 admin admin] Request method failure captured: Jun 07 14:14:40.112049 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 07 14:14:40.112049 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: Accept: application/json Jun 07 14:14:40.112049 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: Accept-Encoding: gzip, deflate Jun 07 14:14:40.112049 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: Connection: keep-alive Jun 07 14:14:40.112049 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: Content-Length: 0 Jun 07 14:14:40.112049 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: Host: 10.222.0.81 Jun 07 14:14:40.112049 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: Openstack-Api-Version: compute 2.90 Jun 07 14:14:40.112049 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: Openstack-System-Scope: None Jun 07 14:14:40.112049 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: User-Agent: python-novaclient Jun 07 14:14:40.112049 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Auth-Token: gAAAAABin11P6rviJluK5iOfehP74d6GrmWO-dVt33Tes664ph5rl2mp3zJDRFndMZ6nFTbwUFRvFI16OXQTn1xv2C9T4VUXrBrJo-5J5w85p8M-Vxqz1ItGwPHmuDb3d2-u4XTvF5p1phVXUD-GfYBIXWyw--4pG2ZrnFNm2TaUoZjZQRSz2yc Jun 07 14:14:40.112049 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Domain-Id: None Jun 07 14:14:40.112049 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Domain-Name: None Jun 07 14:14:40.112049 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Identity-Status: Confirmed Jun 07 14:14:40.112049 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Is-Admin-Project: True Jun 07 14:14:40.112049 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 14:14:40.112049 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Project-Domain-Id: default Jun 07 14:14:40.112049 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Project-Domain-Name: Default Jun 07 14:14:40.112049 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Project-Id: 50e31e6b5bc94b188158e931e4ee4076 Jun 07 14:14:40.112049 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Project-Name: admin Jun 07 14:14:40.112049 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Role: member,reader,admin Jun 07 14:14:40.112049 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Roles: member,reader,admin Jun 07 14:14:40.113634 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/50e31e6b5bc94b188158e931e4ee4076"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_50e31e6b5bc94b188158e931e4ee4076", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/50e31e6b5bc94b188158e931e4ee4076"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/50e31e6b5bc94b188158e931e4ee4076"}]}] Jun 07 14:14:40.113634 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Tenant: admin Jun 07 14:14:40.113634 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Tenant-Id: 50e31e6b5bc94b188158e931e4ee4076 Jun 07 14:14:40.113634 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-Tenant-Name: admin Jun 07 14:14:40.113634 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-User: admin Jun 07 14:14:40.113634 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-User-Domain-Id: default Jun 07 14:14:40.113634 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-User-Domain-Name: Default Jun 07 14:14:40.113634 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-User-Id: 2604a49f226a4bdf958c4047caf193e8 Jun 07 14:14:40.113634 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: X-User-Name: admin Jun 07 14:14:40.113634 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: method: > Jun 07 14:14:40.113634 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: exception: Flavor 451 could not be found. Jun 07 14:14:40.113634 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: action_args: {'id': '451'} Jun 07 14:14:40.113634 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:14:40.113634 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:14:40.114827 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 14:14:40.114827 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 14:14:40.114827 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 14:14:40.114827 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 14:14:40.114827 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 14:14:40.114827 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 14:14:40.114827 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 14:14:40.114827 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 14:14:40.114827 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 14:14:40.114827 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:14:40.114827 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 14:14:40.114827 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 14:14:40.114827 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 07 14:14:40.114827 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 07 14:14:40.114827 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:14:40.114827 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 07 14:14:40.114827 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:14:40.114827 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:14:40.114827 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:14:40.116464 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:14:40.116464 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:14:40.116464 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:14:40.116464 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:14:40.116464 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 14:14:40.116464 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:14:40.116464 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 07 14:14:40.116464 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 07 14:14:40.116464 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:14:40.116464 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 07 14:14:40.116464 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:14:40.116464 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:14:40.116464 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:14:40.116464 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:14:40.116464 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:14:40.116464 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 07 14:14:40.116464 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 07 14:14:40.116464 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-92de533c-58cc-4267-9b07-7b132fb10399 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:14:40.117708 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-92de533c-58cc-4267-9b07-7b132fb10399 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011942 Jun 07 14:14:40.117708 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 27/52] 10.222.0.81 () {60 vars in 1193 bytes} [Tue Jun 7 14:14:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 14:14:40.996976 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-db19a19a-19a9-4cd2-a090-0efdcc818237 admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:40.997988 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-db19a19a-19a9-4cd2-a090-0efdcc818237 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jun 07 14:14:40.998390 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 26/53] 10.222.0.81 () {56 vars in 1074 bytes} [Tue Jun 7 14:14:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:14:41.192108 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-7580928c-b266-44e2-a3ac-1bf995e6b544 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:14:41.210058 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-7580928c-b266-44e2-a3ac-1bf995e6b544 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070118 Jun 07 14:14:41.210564 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 28/54] 10.222.0.81 () {64 vars in 1235 bytes} [Tue Jun 7 14:14:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:14:42.073216 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-db19a19a-19a9-4cd2-a090-0efdcc818237 admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:42.074521 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-db19a19a-19a9-4cd2-a090-0efdcc818237 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jun 07 14:14:42.074946 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 27/55] 10.222.0.81 () {56 vars in 1074 bytes} [Tue Jun 7 14:14:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:14:42.265431 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-5099916d-517f-43ab-9a9e-c28e594b42df admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:14:42.282495 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-5099916d-517f-43ab-9a9e-c28e594b42df admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069592 Jun 07 14:14:42.282970 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 29/56] 10.222.0.81 () {64 vars in 1235 bytes} [Tue Jun 7 14:14:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 14:14:43.156635 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-db19a19a-19a9-4cd2-a090-0efdcc818237 admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:43.157639 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-db19a19a-19a9-4cd2-a090-0efdcc818237 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 07 14:14:43.158034 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 28/57] 10.222.0.81 () {56 vars in 1074 bytes} [Tue Jun 7 14:14:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:14:43.348430 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-58fbbcea-f139-4d95-886c-1c0698458a13 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:14:43.366619 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-58fbbcea-f139-4d95-886c-1c0698458a13 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068994 Jun 07 14:14:43.367160 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 30/58] 10.222.0.81 () {64 vars in 1235 bytes} [Tue Jun 7 14:14:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:14:44.243844 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-db19a19a-19a9-4cd2-a090-0efdcc818237 admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:44.244848 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-db19a19a-19a9-4cd2-a090-0efdcc818237 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 07 14:14:44.245249 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 29/59] 10.222.0.81 () {56 vars in 1074 bytes} [Tue Jun 7 14:14:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:14:44.435493 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-49eb84ba-4f57-4ccf-9418-5ec38bc5ac4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:14:44.453442 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-49eb84ba-4f57-4ccf-9418-5ec38bc5ac4e admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069547 Jun 07 14:14:44.453972 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 31/60] 10.222.0.81 () {64 vars in 1235 bytes} [Tue Jun 7 14:14:44 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 14:14:45.330354 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-db19a19a-19a9-4cd2-a090-0efdcc818237 admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:45.331399 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-db19a19a-19a9-4cd2-a090-0efdcc818237 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jun 07 14:14:45.331801 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 30/61] 10.222.0.81 () {56 vars in 1074 bytes} [Tue Jun 7 14:14:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:14:45.522486 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-0f3a2e96-6a08-4189-abb9-3abce73d431e admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:14:45.542636 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-0f3a2e96-6a08-4189-abb9-3abce73d431e admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072290 Jun 07 14:14:45.543107 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 32/62] 10.222.0.81 () {60 vars in 1202 bytes} [Tue Jun 7 14:14:45 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:15:47.323049 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-db19a19a-19a9-4cd2-a090-0efdcc818237 admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:15:47.324098 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-db19a19a-19a9-4cd2-a090-0efdcc818237 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 07 14:15:47.324498 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 31/63] 10.222.0.81 () {54 vars in 930 bytes} [Tue Jun 7 14:15:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:15:47.331640 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:15:47.384523 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-017d9879-ca93-4a05-a18a-8ffa50878232 admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:15:47.404217 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-017d9879-ca93-4a05-a18a-8ffa50878232 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074012 Jun 07 14:15:47.404752 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 33/64] 10.222.0.81 () {60 vars in 1291 bytes} [Tue Jun 7 14:15:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:15:47.425235 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG dbcounter [-] [103152] Writing DB stats nova_api:SELECT=14 {{(pid=103152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:15:47.429215 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-505e6816-a22d-4730-83cb-bc042c25d9b4 admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:15:47.437097 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-505e6816-a22d-4730-83cb-bc042c25d9b4 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013489 Jun 07 14:15:47.437629 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 32/65] 10.222.0.81 () {60 vars in 1282 bytes} [Tue Jun 7 14:15:47 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:15:47.449517 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-b75d067c-7daf-445b-8ca9-055560d302d8 admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:15:47.457809 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-b75d067c-7daf-445b-8ca9-055560d302d8 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011181 Jun 07 14:15:47.458320 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 34/66] 10.222.0.81 () {60 vars in 1285 bytes} [Tue Jun 7 14:15:47 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:15:47.469411 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-b49b98a5-5062-4150-bdca-52fa66cd60ba admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:15:47.476963 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-b49b98a5-5062-4150-bdca-52fa66cd60ba admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011055 Jun 07 14:15:47.477479 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 33/67] 10.222.0.81 () {60 vars in 1285 bytes} [Tue Jun 7 14:15:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:15:47.488982 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-b1e92578-4e8a-4658-82b8-281b17dd7bed admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:15:47.496834 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-b1e92578-4e8a-4658-82b8-281b17dd7bed admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011527 Jun 07 14:15:47.497337 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 35/68] 10.222.0.81 () {60 vars in 1282 bytes} [Tue Jun 7 14:15:47 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:19:13.970933 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-b49b98a5-5062-4150-bdca-52fa66cd60ba admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:19:13.972072 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-b49b98a5-5062-4150-bdca-52fa66cd60ba admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Jun 07 14:19:13.972472 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 34/69] 10.222.0.81 () {56 vars in 1074 bytes} [Tue Jun 7 14:19:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:19:14.130361 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_api:SELECT=6 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:19:14.244642 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-b2c948c0-699a-44ec-904b-d92e4a4e9b6e admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:19:14.245830 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:19:14.245830 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: warnings.warn(msg) Jun 07 14:19:14.247150 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-b2c948c0-699a-44ec-904b-d92e4a4e9b6e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:19:14.247684 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-b2c948c0-699a-44ec-904b-d92e4a4e9b6e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:19:14.248559 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-b2c948c0-699a-44ec-904b-d92e4a4e9b6e admin admin] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:19:14.249124 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-b2c948c0-699a-44ec-904b-d92e4a4e9b6e admin admin] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:19:14.282866 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-b2c948c0-699a-44ec-904b-d92e4a4e9b6e admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.153993 Jun 07 14:19:14.283458 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 36/70] 10.222.0.81 () {60 vars in 1193 bytes} [Tue Jun 7 14:19:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:19:15.174026 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-b49b98a5-5062-4150-bdca-52fa66cd60ba admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:19:15.175032 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-b49b98a5-5062-4150-bdca-52fa66cd60ba admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 07 14:19:15.175463 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 35/71] 10.222.0.81 () {56 vars in 1074 bytes} [Tue Jun 7 14:19:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:19:15.404865 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-567ef649-d63b-439e-bb88-a7c265f405db admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:19:15.406034 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:19:15.406034 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: warnings.warn(msg) Jun 07 14:19:15.407460 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-567ef649-d63b-439e-bb88-a7c265f405db admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:19:15.407997 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-567ef649-d63b-439e-bb88-a7c265f405db admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:19:15.408814 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-567ef649-d63b-439e-bb88-a7c265f405db admin admin] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:19:15.409241 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-567ef649-d63b-439e-bb88-a7c265f405db admin admin] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:19:15.431293 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-567ef649-d63b-439e-bb88-a7c265f405db admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.089584 Jun 07 14:19:15.435364 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 37/72] 10.222.0.81 () {60 vars in 1193 bytes} [Tue Jun 7 14:19:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 14:19:26.732654 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-b49b98a5-5062-4150-bdca-52fa66cd60ba admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:19:26.733754 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-b49b98a5-5062-4150-bdca-52fa66cd60ba admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002124 Jun 07 14:19:26.734077 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 36/73] 10.222.0.81 () {56 vars in 1074 bytes} [Tue Jun 7 14:19:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:19:26.873671 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_cell0:SELECT=4 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:19:26.874568 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_cell1:SELECT=4 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:19:26.875494 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_api:SELECT=8 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:19:26.927490 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-29ad69dd-5fb7-484c-92b6-16f2e17e006e admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:19:26.928669 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:19:26.928669 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: warnings.warn(msg) Jun 07 14:19:26.929845 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-29ad69dd-5fb7-484c-92b6-16f2e17e006e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:19:26.930282 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-29ad69dd-5fb7-484c-92b6-16f2e17e006e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:19:26.931057 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-29ad69dd-5fb7-484c-92b6-16f2e17e006e admin admin] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:19:26.931506 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-29ad69dd-5fb7-484c-92b6-16f2e17e006e admin admin] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:19:26.958201 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-29ad69dd-5fb7-484c-92b6-16f2e17e006e admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085953 Jun 07 14:19:26.958756 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 38/74] 10.222.0.81 () {60 vars in 1193 bytes} [Tue Jun 7 14:19:26 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:19:27.856452 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: DEBUG nova.api.openstack.wsgi [None req-b49b98a5-5062-4150-bdca-52fa66cd60ba admin admin] Calling method '>' {{(pid=103152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:19:27.858121 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: INFO nova.api.openstack.requestlog [None req-b49b98a5-5062-4150-bdca-52fa66cd60ba admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002117 Jun 07 14:19:27.858526 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: [pid: 103152|app: 0|req: 37/75] 10.222.0.81 () {56 vars in 1074 bytes} [Tue Jun 7 14:19:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:19:28.048277 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-cc448f5c-dd83-45b7-b417-8a4d07eef9de admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:19:28.049434 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:19:28.049434 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: warnings.warn(msg) Jun 07 14:19:28.050603 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-cc448f5c-dd83-45b7-b417-8a4d07eef9de admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:19:28.051046 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-cc448f5c-dd83-45b7-b417-8a4d07eef9de admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:19:28.051874 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-cc448f5c-dd83-45b7-b417-8a4d07eef9de admin admin] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:19:28.052301 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-cc448f5c-dd83-45b7-b417-8a4d07eef9de admin admin] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:19:28.073849 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-cc448f5c-dd83-45b7-b417-8a4d07eef9de admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077023 Jun 07 14:19:28.074323 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 39/76] 10.222.0.81 () {60 vars in 1193 bytes} [Tue Jun 7 14:19:27 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:20:28.853232 dv-cinder-836083-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 07 14:20:28.854101 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: Tue Jun 7 14:20:28 2022 - graceful shutdown triggered... Jun 07 14:20:28.854605 dv-cinder-836083-9-iscsi devstack@n-api.service[103151]: Gracefully killing worker 1 (pid: 103151)... Jun 07 14:20:28.855030 dv-cinder-836083-9-iscsi devstack@n-api.service[103152]: Gracefully killing worker 2 (pid: 103152)... Jun 07 14:20:29.855335 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: worker 1 buried after 1 seconds Jun 07 14:20:29.855335 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: worker 2 buried after 1 seconds Jun 07 14:20:29.855335 dv-cinder-836083-9-iscsi devstack@n-api.service[103150]: goodbye to uWSGI. Jun 07 14:20:29.856800 dv-cinder-836083-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 07 14:20:29.857370 dv-cinder-836083-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 07 14:20:29.859978 dv-cinder-836083-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 07 14:20:29.874520 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 07 14:20:29.895161 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 7 14:20:29 2022] *** Jun 07 14:20:29.895161 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 07 14:20:29.895161 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 07 14:20:29.895161 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: nodename: dv-cinder-836083-9-iscsi Jun 07 14:20:29.895161 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: machine: x86_64 Jun 07 14:20:29.895161 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: clock source: unix Jun 07 14:20:29.895161 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: pcre jit disabled Jun 07 14:20:29.895161 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: detected number of CPU cores: 4 Jun 07 14:20:29.895161 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: current working directory: / Jun 07 14:20:29.895161 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: detected binary path: /usr/bin/uwsgi-core Jun 07 14:20:29.895987 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: your processes number limit is 47680 Jun 07 14:20:29.895987 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: your memory page size is 4096 bytes Jun 07 14:20:29.895987 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: detected max file descriptor number: 2048 Jun 07 14:20:29.895987 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: lock engine: pthread robust mutexes Jun 07 14:20:29.895987 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: thunder lock: enabled Jun 07 14:20:29.895987 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 07 14:20:29.895987 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 07 14:20:29.945069 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: Python main interpreter initialized at 0x563b966109c0 Jun 07 14:20:29.945069 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: python threads support enabled Jun 07 14:20:29.945069 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: your server socket listen backlog is limited to 100 connections Jun 07 14:20:29.945069 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: your mercy for graceful operations on workers is 90 seconds Jun 07 14:20:29.945514 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: mapped 403077 bytes (393 KB) for 2 cores Jun 07 14:20:29.945514 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: *** Operational MODE: preforking *** Jun 07 14:20:29.945767 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: *** uWSGI is running in multiple interpreter mode *** Jun 07 14:20:29.945767 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: spawned uWSGI master process (pid: 117548) Jun 07 14:20:29.945974 dv-cinder-836083-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 07 14:20:29.946578 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: spawned uWSGI worker 1 (pid: 117564, cores: 1) Jun 07 14:20:29.947132 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: spawned uWSGI worker 2 (pid: 117565, cores: 1) Jun 07 14:20:29.947579 dv-cinder-836083-9-iscsi devstack@n-api.service[117548]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 07 14:20:31.193112 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 14:20:31.218821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 14:20:32.034610 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 14:20:32.034610 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: from cryptography.utils import int_from_bytes Jun 07 14:20:32.034940 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 14:20:32.034940 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: from cryptography.utils import int_from_bytes Jun 07 14:20:32.061560 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 14:20:32.061560 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: from cryptography.utils import int_from_bytes Jun 07 14:20:32.061896 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 14:20:32.061896 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: from cryptography.utils import int_from_bytes Jun 07 14:20:34.489948 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 14:20:34.490601 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 14:20:34.490734 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 14:20:34.491105 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 14:20:34.491405 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 14:20:34.491802 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.492135 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.492454 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.492781 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.493120 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.493440 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.493771 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.494097 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.494433 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.494699 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.495022 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.495388 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-9-iscsi {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.495721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.496036 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.496354 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.496678 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.496995 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.497325 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.497638 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.498146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.498600 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.498914 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.499257 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.499595 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.500105 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.500424 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.500751 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.501621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.501965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.502287 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.502697 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-9-iscsi {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.503022 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.503368 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.503693 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.504119 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.504437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.504843 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.505078 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.505409 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.505728 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.506059 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.506387 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.506719 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.507048 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.507387 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.507702 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.508021 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.508348 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.508665 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.508979 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.509235 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.509431 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 14:20:34.509865 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.509987 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 14:20:34.510104 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.510215 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.510313 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 14:20:34.510494 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.510590 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 14:20:34.510752 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.510855 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 14:20:34.511010 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.511168 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.511386 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.511519 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.511679 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.511839 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.511994 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.512156 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.512312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.512492 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.512676 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.512821 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.512921 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.513120 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.513244 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.513439 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.513544 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.513770 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.513928 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.514026 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.514112 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.514330 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.514428 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.514658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-9-iscsi {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.514760 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.514982 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.515075 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.515318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.515430 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.515630 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.515748 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.515948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.516053 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.516255 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.516356 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.516579 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.517477 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.517640 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.517739 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.517833 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.517930 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.518127 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.518249 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.518465 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.518564 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.519171 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.519281 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.519374 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.519447 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.519527 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.519607 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.519842 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.519938 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.520086 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.520189 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.520370 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.520486 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.520677 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.520775 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.520936 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.521035 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.521237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.521350 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-9-iscsi {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.521532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.521722 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.521912 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.521993 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.522270 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.522368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.522468 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.522659 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.522787 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.522976 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.523084 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.523319 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.523455 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.523645 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.523749 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.523953 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.524055 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.524263 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.524371 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.524571 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.524675 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.524882 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.524988 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.525194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.525290 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.525505 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.525612 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.525805 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.525920 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.526114 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.526220 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.526424 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.526588 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.526730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.526868 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.527016 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.527157 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.527327 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.527470 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.527645 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.527858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.528074 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.528223 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.528372 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.528532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.528696 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.528843 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.528991 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.529142 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.529295 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.529438 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.529585 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.529728 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.529867 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.530017 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.530166 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.530321 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.530469 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.530616 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.530767 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.530921 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.531070 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.531256 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.531409 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.531562 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.531711 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.531860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.532000 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.532158 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.532346 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.532571 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.532836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.533113 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.533413 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.533563 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.533563 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.533842 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.533980 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.534129 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.534277 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.534416 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.534566 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.534714 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.534861 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.535023 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.535172 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.535338 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.535479 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.535628 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.535777 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.535919 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.536059 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.536208 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.536349 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.536499 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.536652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.536800 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.536942 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.537087 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.537236 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.537377 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.537377 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.537651 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.537789 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.537927 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.538067 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.538226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.538381 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.538529 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.538676 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.538822 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.538972 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.539136 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.539362 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.539520 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.539660 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.539807 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.539947 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.540102 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.540254 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.540394 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.540542 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.540689 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.540836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.540989 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.541138 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.541138 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.541413 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.541558 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.541698 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.541917 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.542064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.542223 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.542370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.542510 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.542662 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.542802 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.542941 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.543079 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.543244 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.543603 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.543772 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.543915 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.544065 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.544213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.544365 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.544506 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.544660 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.544812 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.544960 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.545109 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.545255 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.545403 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.545557 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.545698 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.545848 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.546000 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.546158 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.546309 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.546451 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.546591 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.546739 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.546881 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.547027 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.547169 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.547169 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.547505 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.547661 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.547809 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.547983 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.548208 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.548456 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.548686 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.548931 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.549169 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.549416 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.549616 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.549763 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.549911 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.550106 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.550262 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.550895 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.551058 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.551201 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.551391 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.551545 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.551698 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.551846 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.551993 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.552141 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.552289 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.552447 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.552595 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.552744 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.552902 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.553044 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.553044 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.553324 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.553692 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.553879 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.554044 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.554194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.554335 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.554483 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.554624 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.554764 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.554911 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.555063 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.555261 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:20:34.555411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.555552 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.555690 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.555831 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.555984 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.556138 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.556279 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.556427 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.556576 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.556576 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.556857 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.557026 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.557168 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.557314 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.557464 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.557611 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.557764 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.557905 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.558045 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.558191 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.558331 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.558471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.558618 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.558768 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.558907 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.559116 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.559282 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.559430 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.559583 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.559724 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.559871 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.560012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.560152 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.560291 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.560443 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.560583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.560733 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.560881 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.561028 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.561178 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.561326 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.561467 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.561612 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.561759 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.561906 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.562060 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.562203 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.562349 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.562496 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.562647 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.562794 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.562946 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.563086 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.563267 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.563426 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.564102 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.564414 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.564669 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.564891 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.565048 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.565190 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.565337 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.565500 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.565649 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.565790 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.565936 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.566084 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.566231 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.566381 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.566381 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.566655 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.566794 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.566940 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.567081 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.567259 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.567419 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.567560 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.567707 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.567854 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.567994 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.568147 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.568295 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.568444 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.568585 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.568724 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.568948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.569091 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.569241 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.569389 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.569531 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.569677 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.569834 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.569974 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.570113 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.570252 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.570392 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.570532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.570725 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.570870 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.571016 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.571167 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.571366 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.571508 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.571658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.571798 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.571944 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.572085 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.572261 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.572402 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.572554 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.572703 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.572850 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.572990 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.573139 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.573294 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.573446 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.573594 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.573745 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.573892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.574039 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.574191 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.574350 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.574576 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.574774 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.574927 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.575075 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.575272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.575433 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.575433 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.575707 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.575847 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.575986 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.576146 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.576287 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.576426 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.576572 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.576712 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.576864 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.577021 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.577169 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.577316 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.577463 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.577603 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.577750 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.577898 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.578046 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.578187 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.578326 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.578466 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.578617 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.578757 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.578907 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.579054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.579298 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.580000 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.580253 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.580491 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.580644 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.580805 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.580998 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.581150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.581298 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.581438 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.581578 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.581735 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.581875 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.582028 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.582170 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.582317 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.582457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.582602 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.582753 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.582907 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.583054 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.583202 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.583376 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.583516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.583516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.583817 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.583964 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.584111 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.584252 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.584398 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.584565 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.584712 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.584860 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.585007 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.585154 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.585295 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.585456 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.585598 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.585737 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.585876 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.586016 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.586154 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.586303 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.586443 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.586582 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.586720 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.586875 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.587021 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.587175 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.587367 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.587514 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.587660 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.587807 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.587964 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.588112 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.588265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.588419 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.588572 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.588719 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.588873 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.589019 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.589164 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.589319 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.589466 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.589619 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.589774 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.589920 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.590072 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.590218 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.590363 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.590517 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.590675 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.590822 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.590976 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.591122 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.591309 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.591474 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.591474 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.591777 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.591925 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.592070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.592070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.592356 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.592503 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.592649 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.592801 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.592955 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.592955 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.593250 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.593409 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.593555 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.593709 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.593862 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.593862 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.594154 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.594301 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.594447 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.594599 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.594746 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.594746 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.595165 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.595480 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.595671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.595823 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.595969 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.596124 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.596280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.596434 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.596589 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.596752 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.596906 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.597066 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.597220 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.597383 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.597537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.597691 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.597838 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.598059 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.598209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.598354 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.598508 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.599261 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.599261 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.599573 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.599730 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.599879 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.600038 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.600184 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.600340 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.600487 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.600487 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.600765 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.600765 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.601061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.601221 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.601375 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.601522 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.601522 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.601806 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.601965 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.602127 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.602282 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.602438 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.602839 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.602994 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.603150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.603342 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.603495 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.603649 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.603796 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.603941 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.604109 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.604257 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.604410 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.604570 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.604726 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.604872 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.605025 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.605179 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.605326 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.605471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.605625 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.605781 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.605997 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.606161 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.606319 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.606474 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.606631 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.606785 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.606939 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.607092 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.607289 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.607460 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.607608 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.607753 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.607914 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.608068 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.608228 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.608384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.608552 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.608712 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.608866 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.609020 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.609174 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.609330 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.609486 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.609639 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.609786 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.609931 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.610085 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.610243 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.610415 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.610644 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.610893 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.611121 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.611310 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.611475 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.611624 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.611770 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.611924 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.612080 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.612236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.612394 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.612542 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.612688 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.612844 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.612844 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.613131 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.613302 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.613455 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.613611 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.613758 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.613917 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.614070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.614225 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.614382 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.614529 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.614676 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.614834 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.614981 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.615127 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.615300 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.615461 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.615610 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.615769 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.615916 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.616063 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.616208 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.616364 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.616517 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.616674 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.616828 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.616982 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.617138 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.617138 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.617431 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.617578 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.617732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.617879 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.618031 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.618177 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.618350 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.618497 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.618649 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.618804 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.618950 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.619096 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.619287 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.619449 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.619596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.619749 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.619903 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.620058 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.620229 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.620377 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.620530 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.620741 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.620892 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.621038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.621191 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.621337 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.621526 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.621718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.621867 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.622014 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.622167 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.622326 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.622473 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.622627 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.622774 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.622927 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.623075 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.623248 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.623424 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.623581 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.623735 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.623881 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.624029 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.624175 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.624351 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.624500 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.624654 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.624808 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.624955 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.625110 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.625266 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.625414 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.625567 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.625721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.625869 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.626546 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.626799 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.627075 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.627407 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.627577 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.627726 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.627886 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.628040 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.628197 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.628350 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.628498 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.628653 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.628876 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.629034 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.629193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.629341 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.629496 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.629644 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.629803 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.629951 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.630105 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.630253 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.630400 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.630547 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.630702 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.630850 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.631003 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.631166 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.631340 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.631501 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.631657 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.631812 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.631959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.632111 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.632111 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.632408 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.632557 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.632709 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.632864 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.633010 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.633169 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.633324 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.633480 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.633626 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.633779 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.633938 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.634084 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.634239 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.634394 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.634542 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.634695 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.634852 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.635007 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.635164 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.635386 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.635536 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.635690 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.635836 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.636057 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.636207 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.636353 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.636500 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.636654 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.636808 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.636969 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.637157 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.637341 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.637497 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.637653 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.637800 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.637955 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.637955 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.638235 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.638394 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.638541 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.638701 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.638848 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.639001 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.639166 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.639339 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.639498 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.639658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.639813 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.639975 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.640121 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.640267 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.640412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.640567 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.640720 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.640868 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.641013 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.641169 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.641324 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.641485 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.641659 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.642374 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.642627 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.642837 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.643004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.643153 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.643339 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.643447 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.643556 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.643649 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.643749 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.643838 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.643924 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.644010 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.644102 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.644195 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.644294 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.644387 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.644472 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.644562 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.644654 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.644741 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.644866 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.644952 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.645072 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.645181 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.645258 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.645361 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.645361 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.645497 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.645576 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.645648 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.645727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.645807 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.645886 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.645959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.646030 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.646108 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.646181 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.646260 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.646333 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.646410 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.646482 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.646559 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.646643 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.646740 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.646821 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.646894 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.646965 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.647036 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.647148 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.647247 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.647325 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.647396 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.647479 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.647559 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.647640 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.647731 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.647804 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.647875 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.647952 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.648024 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.648107 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.648186 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.648258 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.648330 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.648400 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.648471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.648555 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.648708 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.648827 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.649026 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.649134 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.649347 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.649526 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.649687 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.649844 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.650001 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.650156 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.650314 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.650469 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.650623 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.650769 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.650916 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.651061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.651245 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.651413 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.651571 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.651719 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.651864 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.652010 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.652170 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.652318 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.652472 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.652626 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.652840 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.653010 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.653166 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.653313 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.653484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.653632 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.653784 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.654007 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.654181 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.654333 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.654488 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.654637 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.654783 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.654938 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.655140 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.655342 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.655527 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.655692 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.655838 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.655994 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.656142 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.656288 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.656433 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.656581 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.656752 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.656902 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.657057 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.657234 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.657410 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.657669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.657937 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.658157 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.658313 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.658461 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.658616 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.658764 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.658920 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.659085 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.659332 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.659487 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.659635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.659783 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.659960 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.660111 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.660258 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.660427 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.660594 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.660751 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.660906 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.661054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.661209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.661364 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.661519 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.661675 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.661823 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.661987 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.662143 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.662298 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.662459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.662608 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.662754 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.662909 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.663056 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.663254 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.663423 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.663573 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.663719 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.663875 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.664033 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.664189 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.664336 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.664483 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.664630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.664776 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.664931 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.665086 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.665234 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.665234 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.665522 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.665670 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.665840 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.665998 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.666146 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.666300 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.666447 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.666601 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.666769 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.666926 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.667074 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.667074 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.667386 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.667544 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.667705 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.667870 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.668026 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.668175 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.668346 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.668543 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.668701 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.668848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.669002 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.669150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.669314 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.669537 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.669703 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.669852 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.670017 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.670178 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.670332 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.670493 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.670640 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.670832 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.670984 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.670984 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.671319 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.671483 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.671640 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.671794 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.671958 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.672113 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.672269 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.672425 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.672572 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.672725 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.672879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.673067 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.673329 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.673582 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.673771 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.673920 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.674067 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.674233 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.674395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.674543 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.674690 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.674842 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.674989 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.675136 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.675323 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.675482 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.675639 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.675794 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.675950 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.675950 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.676254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.676403 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.676549 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.676708 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.676866 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.677013 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.677168 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.677323 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.677470 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.677616 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.677774 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.677930 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.678083 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.678246 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.678394 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.678548 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.678701 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.678857 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.679004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.679151 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.679322 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.679480 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.679726 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.679897 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.680046 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.680191 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.680349 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.680496 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.680651 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.680806 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.680953 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.681109 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.681109 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.681403 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.681563 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.681711 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.681858 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.682003 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.682160 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.682308 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.682467 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.682621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.682769 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.682915 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.683061 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.683213 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.683454 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.683605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.683760 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.683906 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.684120 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.684304 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.684453 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.684601 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.684755 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.684903 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.685057 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.685213 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.685361 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.685507 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.685661 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.685815 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.685963 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.686129 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.686291 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.686439 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.686598 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.686764 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.686927 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.687074 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.687284 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.687457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.687618 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.687764 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.687919 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.688079 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.688234 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.688380 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.689030 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.689262 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.689534 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.689738 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.689965 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.690131 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.690297 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.690454 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.690602 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.690755 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.690915 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.691070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.691247 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.691247 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.691623 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.691771 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.691925 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.692073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.692227 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.692389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.692537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.692690 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.692855 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.693003 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.693157 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.693314 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.693461 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.693607 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.693759 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.693914 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.694073 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.694221 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.694374 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.694521 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.694521 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.694825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.694985 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.695211 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.695434 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.695584 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.695584 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.695864 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.696023 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.696171 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.696328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.696476 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.696629 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.696787 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.696787 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.697097 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.697252 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.697400 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.697556 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.697716 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.697873 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.698026 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.698173 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.698326 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.698480 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.698707 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.698872 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.699028 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.699184 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.699371 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.699529 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.699743 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.699743 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.700132 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.700287 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.700442 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.700442 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.700742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.700908 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.701056 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.701203 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.701356 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.701513 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.701662 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.701808 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.701965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.702113 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.702268 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.702415 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.702415 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.702757 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.702923 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.703071 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.703283 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.703440 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.703598 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.703745 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.703898 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.704051 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.704258 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.704468 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.704707 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.704968 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.705187 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.705347 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.705505 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.705653 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.705802 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.705949 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.706105 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.706266 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.706422 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.706569 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.706722 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.706875 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.706875 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.707174 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.707355 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.707504 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.707662 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.707810 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.707965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.708126 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.708274 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.708427 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.708574 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.708721 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.708866 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.708866 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.709178 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.709332 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.709479 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.709624 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.709782 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.709930 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.710076 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.710314 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.710477 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.710624 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.710781 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.710936 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.711095 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.711266 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.711422 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.711579 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.711739 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.711739 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.712028 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.712175 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.712329 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.712476 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.712634 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.712788 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.712942 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.713100 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.713247 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.713406 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.713553 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.713714 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.713868 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.713868 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.714148 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.714304 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.714459 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.714612 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.714766 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.714929 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.715084 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.715084 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.715467 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.715622 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.715770 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.715923 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.716080 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.716229 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.716377 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.716530 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.716691 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.716850 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.717016 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.717180 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.717330 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.717476 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.717476 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.717754 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.717913 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.718060 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.718207 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.718354 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.718500 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.718656 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.718818 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.718975 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.719123 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.719320 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.719477 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.719637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.720309 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.720602 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.720868 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.721087 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.721241 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.721402 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.721552 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.721710 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.721857 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.722012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.722167 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.722327 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.722476 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.722630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.722785 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.722785 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.723066 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.723244 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.723402 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.723550 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.723707 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.723864 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.724025 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.724173 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.724319 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.724466 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.724620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.724776 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.724939 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.725094 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.725241 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.725387 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.725540 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.725698 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.725855 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.726011 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.726165 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.726320 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.726468 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.726614 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.726771 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.726930 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.727078 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.727278 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.727434 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.727859 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.727859 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.728149 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.728297 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.728450 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.728598 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.728822 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.728822 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.729114 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.729261 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.729416 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.729562 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.729719 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.729885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.730035 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.730182 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.730335 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.730492 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.730733 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.730939 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.731106 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.731280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.731435 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.731599 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.731756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.731917 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.732074 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.732228 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.732382 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.732542 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.732690 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.732835 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.732990 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.733139 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.733294 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.733441 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.733595 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.733749 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.733918 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.734072 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.734234 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.734388 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.734536 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.734689 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.734837 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.734984 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.735144 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.735328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.735558 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.736300 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.736558 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.736726 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.736876 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.737031 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.737186 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.737347 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.737495 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.737650 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.737798 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.737798 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.738078 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.738251 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.738405 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.738573 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.738721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.738867 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.739013 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.739159 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.739382 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.739550 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.739698 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.739852 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.740008 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.740161 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.740323 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.740486 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.740633 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.740873 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.741045 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.741045 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.741336 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.741485 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.741631 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.741777 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.741931 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.742077 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.742232 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.742378 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.742537 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.742683 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.742830 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.742984 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.743131 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.743304 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.743457 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.743615 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.743763 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.743923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.744071 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.744225 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.744382 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.744537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.744693 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.744871 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.745046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.745213 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.745368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.745521 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.745669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.745828 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.745975 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.746128 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.746282 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.746282 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.746648 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.746801 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.746955 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.747111 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.747306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.747460 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.747620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.747778 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.747925 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.748072 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.748218 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.748375 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.748533 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.748688 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.748843 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.748991 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.749137 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.749296 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.749445 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.749598 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.749765 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.749914 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.750061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.750220 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.750380 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.750534 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.750689 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.750854 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.751106 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.751400 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.751651 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.751872 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.752027 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.752182 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.752330 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.752487 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.752487 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.752790 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.752937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.753084 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.753244 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.753392 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.753546 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.753693 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.753847 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.753996 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.754216 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.754387 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.754537 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.754705 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.754862 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.755023 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.755181 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.755363 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.755520 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.755666 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.755820 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.755975 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.756136 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.756290 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.756438 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.756591 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 14:20:34.756749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.756749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.756749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.756749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.756749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.756749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.756749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.756749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.757852 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.757852 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.757852 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.757852 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.757852 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.758620 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.758620 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.758916 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.759061 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.759322 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.759636 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.759948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.760266 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.760577 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.760892 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.761211 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.761527 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.761856 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.762185 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.762493 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.762820 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.763150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.763523 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.763842 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.764180 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.764514 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.764833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.765148 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.765459 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:20:34.765706 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 14:20:34.815062 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO dbcounter [None req-bfa29771-7509-48d2-be04-94833d8d4cc8 None None] Registered counter for database nova_api Jun 07 14:20:34.826640 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO dbcounter [None req-636cc3c3-5c2c-4257-bfb0-1a8c2a7281ad None None] Registered counter for database nova_api Jun 07 14:20:34.835512 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_db.sqlalchemy.engines [None req-bfa29771-7509-48d2-be04-94833d8d4cc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117565) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:20:34.842162 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writer thread running {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:20:34.847317 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_db.sqlalchemy.engines [None req-636cc3c3-5c2c-4257-bfb0-1a8c2a7281ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:20:34.854212 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writer thread running {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:20:34.899848 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.context [None req-bfa29771-7509-48d2-be04-94833d8d4cc8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c8a811e3-dd56-4d67-9958-d177193c9c7e(cell1) {{(pid=117565) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 14:20:34.904123 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bfa29771-7509-48d2-be04-94833d8d4cc8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:20:34.905974 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bfa29771-7509-48d2-be04-94833d8d4cc8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:20:34.906791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bfa29771-7509-48d2-be04-94833d8d4cc8 None None] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:20:34.909426 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bfa29771-7509-48d2-be04-94833d8d4cc8 None None] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:20:34.910443 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.context [None req-636cc3c3-5c2c-4257-bfb0-1a8c2a7281ad None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c8a811e3-dd56-4d67-9958-d177193c9c7e(cell1) {{(pid=117564) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 14:20:34.911449 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO dbcounter [None req-bfa29771-7509-48d2-be04-94833d8d4cc8 None None] Registered counter for database nova_cell0 Jun 07 14:20:34.914571 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-636cc3c3-5c2c-4257-bfb0-1a8c2a7281ad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:20:34.916513 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-636cc3c3-5c2c-4257-bfb0-1a8c2a7281ad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:20:34.916819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO dbcounter [None req-bfa29771-7509-48d2-be04-94833d8d4cc8 None None] Registered counter for database nova_cell1 Jun 07 14:20:34.917314 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-636cc3c3-5c2c-4257-bfb0-1a8c2a7281ad None None] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:20:34.919281 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-636cc3c3-5c2c-4257-bfb0-1a8c2a7281ad None None] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:20:34.921267 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO dbcounter [None req-636cc3c3-5c2c-4257-bfb0-1a8c2a7281ad None None] Registered counter for database nova_cell0 Jun 07 14:20:34.924679 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_db.sqlalchemy.engines [None req-bfa29771-7509-48d2-be04-94833d8d4cc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117565) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:20:34.925622 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_db.sqlalchemy.engines [None req-bfa29771-7509-48d2-be04-94833d8d4cc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117565) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:20:34.927018 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO dbcounter [None req-636cc3c3-5c2c-4257-bfb0-1a8c2a7281ad None None] Registered counter for database nova_cell1 Jun 07 14:20:34.932876 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writer thread running {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:20:34.934212 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_db.sqlalchemy.engines [None req-636cc3c3-5c2c-4257-bfb0-1a8c2a7281ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:20:34.935653 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writer thread running {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:20:34.936537 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_db.sqlalchemy.engines [None req-636cc3c3-5c2c-4257-bfb0-1a8c2a7281ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:20:34.941707 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writer thread running {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:20:34.944281 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writer thread running {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:20:35.083475 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO dbcounter [None req-bfa29771-7509-48d2-be04-94833d8d4cc8 None None] Registered counter for database nova_cell0 Jun 07 14:20:35.091870 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_db.sqlalchemy.engines [None req-bfa29771-7509-48d2-be04-94833d8d4cc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117565) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:20:35.097405 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writer thread running {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:20:35.100246 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO dbcounter [None req-636cc3c3-5c2c-4257-bfb0-1a8c2a7281ad None None] Registered counter for database nova_cell0 Jun 07 14:20:35.107082 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_db.sqlalchemy.engines [None req-636cc3c3-5c2c-4257-bfb0-1a8c2a7281ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:20:35.111723 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writer thread running {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:20:35.552075 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: WARNING keystonemiddleware.auth_token [None req-636cc3c3-5c2c-4257-bfb0-1a8c2a7281ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 14:20:35.552722 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: WARNING keystonemiddleware.auth_token [None req-bfa29771-7509-48d2-be04-94833d8d4cc8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 14:20:35.559640 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: WARNING keystonemiddleware.auth_token [None req-bfa29771-7509-48d2-be04-94833d8d4cc8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 14:20:35.559824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: WARNING keystonemiddleware.auth_token [None req-636cc3c3-5c2c-4257-bfb0-1a8c2a7281ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 14:20:35.785973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: WARNING keystonemiddleware.auth_token [None req-bfa29771-7509-48d2-be04-94833d8d4cc8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 14:20:35.786708 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: WARNING keystonemiddleware.auth_token [None req-636cc3c3-5c2c-4257-bfb0-1a8c2a7281ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 14:20:35.792065 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: WARNING keystonemiddleware.auth_token [None req-bfa29771-7509-48d2-be04-94833d8d4cc8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 14:20:35.792847 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: WARNING keystonemiddleware.auth_token [None req-636cc3c3-5c2c-4257-bfb0-1a8c2a7281ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 14:20:35.797149 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563b966109c0 pid: 117565 (default app) Jun 07 14:20:35.798473 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563b966109c0 pid: 117564 (default app) Jun 07 14:21:18.055624 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=3 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:18.057083 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=3 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:18.058048 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=3 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:18.058999 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=3 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:18.146732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=3 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:18.148085 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=3 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:18.149329 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=3 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:18.150178 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=3 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:19.643869 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-0b239b3a-ed10-4ad6-93ce-e660480c0526 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Action: 'create', calling method: .version_select at 0x7ff3854e45e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1471276941"}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:21:19.729492 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2649bc8a-d3e1-4af9-aa14-edd312421c01 tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] Action: 'create', calling method: .version_select at 0x7ff3854e55e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-707761087", "metadata": {"Type": "work"}}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:21:19.752732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2649bc8a-d3e1-4af9-aa14-edd312421c01 tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] Request method failure captured: Jun 07 14:21:19.752732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 14:21:19.752732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 07 14:21:19.752732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 07 14:21:19.752732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Connection: close Jun 07 14:21:19.752732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Length: 121 Jun 07 14:21:19.752732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 07 14:21:19.752732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Host: 10.222.0.81 Jun 07 14:21:19.752732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 07 14:21:19.752732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 07 14:21:19.752732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABin17eHJTqXilNbzR5J1BOzIFZhwGjXXkMXVoZwDyEzGN3i93F8vxnnrpXiOCv9f-YYSlpXb7I73YNULJixXl0JQnpRrEuUZHHG0wSCFGN1nWebd19m-cNbptD2cUehHAIdNd64yrwz571XO8eAPt-Yk1LNupmY8vAJmL9BPRwg5_i6t8 Jun 07 14:21:19.752732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 07 14:21:19.752732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 07 14:21:19.752732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 07 14:21:19.752732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 07 14:21:19.752732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 07 14:21:19.752732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 07 14:21:19.752732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Id: 95161229e3f14e42857866e55b39ec09 Jun 07 14:21:19.752732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-VolumesNegativeTest-1355482653 Jun 07 14:21:19.752732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Role: member,reader Jun 07 14:21:19.752732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Roles: member,reader Jun 07 14:21:19.754192 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/95161229e3f14e42857866e55b39ec09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_95161229e3f14e42857866e55b39ec09", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/95161229e3f14e42857866e55b39ec09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/95161229e3f14e42857866e55b39ec09"}]}] Jun 07 14:21:19.754192 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-VolumesNegativeTest-1355482653 Jun 07 14:21:19.754192 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 95161229e3f14e42857866e55b39ec09 Jun 07 14:21:19.754192 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-VolumesNegativeTest-1355482653 Jun 07 14:21:19.754192 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User: tempest-VolumesNegativeTest-1355482653-project Jun 07 14:21:19.754192 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 07 14:21:19.754192 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 07 14:21:19.754192 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Id: 7411441cb9894116b5ec11dd1881146f Jun 07 14:21:19.754192 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-VolumesNegativeTest-1355482653-project Jun 07 14:21:19.754192 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Jun 07 14:21:19.754192 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-707761087", "metadata": {"Type": "work"}}} Jun 07 14:21:19.754192 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: method: Jun 07 14:21:19.754192 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 14:21:19.755054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-707761087', 'metadata': {'Type': 'work'}}}} Jun 07 14:21:19.755054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:21:19.755054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:19.755054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 14:21:19.755054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 14:21:19.755054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 14:21:19.755054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise error Jun 07 14:21:19.755054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 07 14:21:19.755054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:19.755054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 07 14:21:19.755054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 14:21:19.755054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:19.755054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 14:21:19.755054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi '#$%' Jun 07 14:21:19.755054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:19.755054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:19.755054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:19.755054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:19.755054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:21:19.755054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:21:19.755054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:21:19.755054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:21:19.756525 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 14:21:19.756525 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 14:21:19.756525 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:21:19.756525 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:21:19.756525 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 14:21:19.756525 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 14:21:19.756525 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 14:21:19.756525 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 14:21:19.756525 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 14:21:19.756525 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 14:21:19.756525 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 14:21:19.756525 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:19.756525 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:19.756525 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:19.756525 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:19.756525 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:21:19.756525 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:21:19.756525 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 14:21:19.756525 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 14:21:19.757732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 14:21:19.757732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:19.759694 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2649bc8a-d3e1-4af9-aa14-edd312421c01 tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:21:19.761075 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2649bc8a-d3e1-4af9-aa14-edd312421c01 tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.626210 Jun 07 14:21:19.766495 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 1/1] 10.222.0.81 () {60 vars in 1155 bytes} [Tue Jun 7 14:21:18 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1633 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 14:21:19.772284 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2512bf2b-ff23-44f3-a05f-b7dae7bfa5a1 tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] Action: 'create', calling method: .version_select at 0x7ff3854f89d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1491186908", "metadata": {"Type": "work"}}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:21:19.776749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2512bf2b-ff23-44f3-a05f-b7dae7bfa5a1 tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] Request method failure captured: Jun 07 14:21:19.776749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 14:21:19.776749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 07 14:21:19.776749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 07 14:21:19.776749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Connection: close Jun 07 14:21:19.776749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Length: 120 Jun 07 14:21:19.776749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 07 14:21:19.776749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Host: 10.222.0.81 Jun 07 14:21:19.776749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 07 14:21:19.776749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 07 14:21:19.776749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABin17eHJTqXilNbzR5J1BOzIFZhwGjXXkMXVoZwDyEzGN3i93F8vxnnrpXiOCv9f-YYSlpXb7I73YNULJixXl0JQnpRrEuUZHHG0wSCFGN1nWebd19m-cNbptD2cUehHAIdNd64yrwz571XO8eAPt-Yk1LNupmY8vAJmL9BPRwg5_i6t8 Jun 07 14:21:19.776749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 07 14:21:19.776749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 07 14:21:19.776749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 07 14:21:19.776749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 07 14:21:19.776749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 07 14:21:19.776749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 07 14:21:19.776749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Id: 95161229e3f14e42857866e55b39ec09 Jun 07 14:21:19.776749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-VolumesNegativeTest-1355482653 Jun 07 14:21:19.776749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Role: member,reader Jun 07 14:21:19.776749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Roles: member,reader Jun 07 14:21:19.778109 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/95161229e3f14e42857866e55b39ec09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_95161229e3f14e42857866e55b39ec09", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/95161229e3f14e42857866e55b39ec09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/95161229e3f14e42857866e55b39ec09"}]}] Jun 07 14:21:19.778109 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-VolumesNegativeTest-1355482653 Jun 07 14:21:19.778109 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 95161229e3f14e42857866e55b39ec09 Jun 07 14:21:19.778109 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-VolumesNegativeTest-1355482653 Jun 07 14:21:19.778109 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User: tempest-VolumesNegativeTest-1355482653-project Jun 07 14:21:19.778109 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 07 14:21:19.778109 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 07 14:21:19.778109 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Id: 7411441cb9894116b5ec11dd1881146f Jun 07 14:21:19.778109 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-VolumesNegativeTest-1355482653-project Jun 07 14:21:19.778109 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Jun 07 14:21:19.778109 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1491186908", "metadata": {"Type": "work"}}} Jun 07 14:21:19.778109 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: method: Jun 07 14:21:19.778109 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 14:21:19.778880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1491186908', 'metadata': {'Type': 'work'}}}} Jun 07 14:21:19.778880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:21:19.778880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:19.778880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 14:21:19.778880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 14:21:19.778880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 14:21:19.778880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise error Jun 07 14:21:19.778880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 07 14:21:19.778880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:19.778880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 07 14:21:19.778880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 14:21:19.778880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:19.778880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 14:21:19.778880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi '0' Jun 07 14:21:19.778880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:19.778880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:19.778880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:19.778880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:19.778880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:21:19.778880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:21:19.778880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:21:19.778880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:21:19.780292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 14:21:19.780292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 14:21:19.780292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:21:19.780292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:21:19.780292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 14:21:19.780292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 14:21:19.780292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 14:21:19.780292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 14:21:19.780292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 14:21:19.780292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 14:21:19.780292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 14:21:19.780292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:19.780292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:19.780292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:19.780292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:19.780292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:21:19.780292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:21:19.780292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 14:21:19.780292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 14:21:19.781920 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 14:21:19.781920 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:19.786959 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2512bf2b-ff23-44f3-a05f-b7dae7bfa5a1 tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:21:19.789967 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2512bf2b-ff23-44f3-a05f-b7dae7bfa5a1 tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020113 Jun 07 14:21:19.790787 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 2/2] 10.222.0.81 () {60 vars in 1155 bytes} [Tue Jun 7 14:21:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 14:21:19.802186 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ad823e50-1fc3-412a-a20f-5f5815f3815e tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] Action: 'create', calling method: .version_select at 0x7ff3854e5940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2018386379", "metadata": {"Type": "work"}}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:21:19.805368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ad823e50-1fc3-412a-a20f-5f5815f3815e tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] Request method failure captured: Jun 07 14:21:19.805368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 14:21:19.805368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 07 14:21:19.805368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 07 14:21:19.805368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Connection: close Jun 07 14:21:19.805368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Length: 119 Jun 07 14:21:19.805368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 07 14:21:19.805368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Host: 10.222.0.81 Jun 07 14:21:19.805368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 07 14:21:19.805368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 07 14:21:19.805368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABin17eHJTqXilNbzR5J1BOzIFZhwGjXXkMXVoZwDyEzGN3i93F8vxnnrpXiOCv9f-YYSlpXb7I73YNULJixXl0JQnpRrEuUZHHG0wSCFGN1nWebd19m-cNbptD2cUehHAIdNd64yrwz571XO8eAPt-Yk1LNupmY8vAJmL9BPRwg5_i6t8 Jun 07 14:21:19.805368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 07 14:21:19.805368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 07 14:21:19.805368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 07 14:21:19.805368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 07 14:21:19.805368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 07 14:21:19.805368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 07 14:21:19.805368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Id: 95161229e3f14e42857866e55b39ec09 Jun 07 14:21:19.805368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-VolumesNegativeTest-1355482653 Jun 07 14:21:19.805368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Role: member,reader Jun 07 14:21:19.805368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Roles: member,reader Jun 07 14:21:19.806696 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/95161229e3f14e42857866e55b39ec09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_95161229e3f14e42857866e55b39ec09", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/95161229e3f14e42857866e55b39ec09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/95161229e3f14e42857866e55b39ec09"}]}] Jun 07 14:21:19.806696 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-VolumesNegativeTest-1355482653 Jun 07 14:21:19.806696 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 95161229e3f14e42857866e55b39ec09 Jun 07 14:21:19.806696 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-VolumesNegativeTest-1355482653 Jun 07 14:21:19.806696 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User: tempest-VolumesNegativeTest-1355482653-project Jun 07 14:21:19.806696 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 07 14:21:19.806696 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 07 14:21:19.806696 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Id: 7411441cb9894116b5ec11dd1881146f Jun 07 14:21:19.806696 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-VolumesNegativeTest-1355482653-project Jun 07 14:21:19.806696 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Jun 07 14:21:19.806696 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2018386379", "metadata": {"Type": "work"}}} Jun 07 14:21:19.806696 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: method: Jun 07 14:21:19.806696 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 14:21:19.808033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2018386379', 'metadata': {'Type': 'work'}}}} Jun 07 14:21:19.808033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:21:19.808033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:19.808033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 14:21:19.808033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 14:21:19.808033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 14:21:19.808033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise error Jun 07 14:21:19.808033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 07 14:21:19.808033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:19.808033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 07 14:21:19.808033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 14:21:19.808033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:19.808033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 14:21:19.808033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi '' Jun 07 14:21:19.808033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:19.808033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:19.808033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:19.808033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:19.808033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:21:19.808033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:21:19.808033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:21:19.808033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:21:19.809352 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 14:21:19.809352 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 14:21:19.809352 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:21:19.809352 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:21:19.809352 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 14:21:19.809352 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 14:21:19.809352 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 14:21:19.809352 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 14:21:19.809352 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 14:21:19.809352 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 14:21:19.809352 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 14:21:19.809352 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:19.809352 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:19.809352 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:19.809352 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:19.809352 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:21:19.809352 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:21:19.809352 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 14:21:19.809352 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 14:21:19.812879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 14:21:19.812879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:19.814305 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ad823e50-1fc3-412a-a20f-5f5815f3815e tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:21:19.815436 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ad823e50-1fc3-412a-a20f-5f5815f3815e tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017065 Jun 07 14:21:19.816558 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 3/3] 10.222.0.81 () {60 vars in 1155 bytes} [Tue Jun 7 14:21:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 07 14:21:19.825931 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a2112f39-41a7-4adf-9253-102a88c94fff tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] Calling method '.version_select at 0x7ff385411700>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:20.919026 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-a2112f39-41a7-4adf-9253-102a88c94fff tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] HTTP exception thrown: Volume tempest-invalid-1985944868 could not be found. Jun 07 14:21:20.930050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a2112f39-41a7-4adf-9253-102a88c94fff tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] Request method failure captured: Jun 07 14:21:20.930050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1985944868 HTTP/1.1 Jun 07 14:21:20.930050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 07 14:21:20.930050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 07 14:21:20.930050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Connection: close Jun 07 14:21:20.930050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 07 14:21:20.930050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 07 14:21:20.930050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Host: 10.222.0.81 Jun 07 14:21:20.930050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 07 14:21:20.930050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 07 14:21:20.930050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABin17eHJTqXilNbzR5J1BOzIFZhwGjXXkMXVoZwDyEzGN3i93F8vxnnrpXiOCv9f-YYSlpXb7I73YNULJixXl0JQnpRrEuUZHHG0wSCFGN1nWebd19m-cNbptD2cUehHAIdNd64yrwz571XO8eAPt-Yk1LNupmY8vAJmL9BPRwg5_i6t8 Jun 07 14:21:20.930050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 07 14:21:20.930050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 07 14:21:20.930050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 07 14:21:20.930050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 07 14:21:20.930050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 07 14:21:20.930050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 07 14:21:20.930050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Id: 95161229e3f14e42857866e55b39ec09 Jun 07 14:21:20.930050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-VolumesNegativeTest-1355482653 Jun 07 14:21:20.930050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Role: member,reader Jun 07 14:21:20.930050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Roles: member,reader Jun 07 14:21:20.931759 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/95161229e3f14e42857866e55b39ec09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_95161229e3f14e42857866e55b39ec09", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/95161229e3f14e42857866e55b39ec09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/95161229e3f14e42857866e55b39ec09"}]}] Jun 07 14:21:20.931759 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-VolumesNegativeTest-1355482653 Jun 07 14:21:20.931759 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 95161229e3f14e42857866e55b39ec09 Jun 07 14:21:20.931759 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-VolumesNegativeTest-1355482653 Jun 07 14:21:20.931759 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User: tempest-VolumesNegativeTest-1355482653-project Jun 07 14:21:20.931759 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 07 14:21:20.931759 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 07 14:21:20.931759 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Id: 7411441cb9894116b5ec11dd1881146f Jun 07 14:21:20.931759 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-VolumesNegativeTest-1355482653-project Jun 07 14:21:20.931759 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: method: Jun 07 14:21:20.931759 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: exception: Volume tempest-invalid-1985944868 could not be found. Jun 07 14:21:20.931759 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: action_args: {'id': 'tempest-invalid-1985944868'} Jun 07 14:21:20.931759 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:21:20.936928 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:20.936928 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:21:20.936928 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:21:20.936928 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 14:21:20.936928 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 14:21:20.936928 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 14:21:20.936928 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 14:21:20.936928 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 14:21:20.936928 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 14:21:20.936928 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 14:21:20.936928 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 14:21:20.936928 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:21:20.936928 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:21:20.936928 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:21:20.936928 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:21:20.936928 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1985944868 could not be found. (HTTP 404) (Request-ID: req-97cb76bc-b6f2-4234-8704-e09e9a83b943) Jun 07 14:21:20.936928 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:20.936928 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:20.936928 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:20.938658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:20.938658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 14:21:20.938658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 14:21:20.938658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 14:21:20.938658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 14:21:20.938658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 14:21:20.938658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 14:21:20.938658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 14:21:20.938658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 14:21:20.938658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:21:20.938658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:21:20.938658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 14:21:20.938658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 14:21:20.938658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 14:21:20.938658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 14:21:20.938658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 14:21:20.938658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 14:21:20.938658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 14:21:20.938658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 14:21:20.939824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:21:20.939824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:21:20.939824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:21:20.939824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:21:20.939824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1985944868 could not be found. Jun 07 14:21:20.939824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:20.939824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:20.939824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:20.939824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:20.939824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:21:20.939824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:21:20.939824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:21:20.939824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:21:20.939824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 14:21:20.939824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 14:21:20.939824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:21:20.939824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:21:20.939824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 14:21:20.939824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:21:20.939824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1985944868 could not be found. Jun 07 14:21:20.941003 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:20.941003 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:20.941003 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:20.941003 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:20.941003 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:21:20.941003 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:21:20.941003 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:21:20.941003 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:21:20.941003 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1985944868 could not be found. Jun 07 14:21:20.941003 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:20.941003 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a2112f39-41a7-4adf-9253-102a88c94fff tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] Returning 404 to user: Volume tempest-invalid-1985944868 could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:21:20.941003 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a2112f39-41a7-4adf-9253-102a88c94fff tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1985944868" status: 404 len: 99 microversion: 2.1 time: 1.110106 Jun 07 14:21:20.941003 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 4/4] 10.222.0.81 () {58 vars in 1217 bytes} [Tue Jun 7 14:21:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1985944868 => generated 99 bytes in 1111 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 07 14:21:21.510851 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a6ced98a-5004-4ea3-a09c-f15f01572d04 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-920235191", "imageRef": "2864004b-970a-480b-8453-14794f9ccca2", "flavorRef": "452", "networks": [{"uuid": "50c06197-9321-4c53-bdd9-d99515e203c8"}]}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:21:21.660003 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-0b239b3a-ed10-4ad6-93ce-e660480c0526 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.613223 Jun 07 14:21:21.662793 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 1/5] 10.222.0.81 () {60 vars in 1154 bytes} [Tue Jun 7 14:21:18 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3618 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 07 14:21:21.668413 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-b2761d07-060a-4f17-93f2-efa766f0c856 tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004122 Jun 07 14:21:21.676175 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 2/6] 10.222.0.81 () {58 vars in 1139 bytes} [Tue Jun 7 14:21:21 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 07 14:21:21.681726 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-35f871cb-7d5a-436b-ac39-3192df9977ad tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Calling method '.version_select at 0x7ff3853ad820>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:21.740884 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.network.neutron [None req-a6ced98a-5004-4ea3-a09c-f15f01572d04 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] validate_networks() for [('50c06197-9321-4c53-bdd9-d99515e203c8', None, None, None, None, None)] {{(pid=117564) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:21:21.786444 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-35f871cb-7d5a-436b-ac39-3192df9977ad tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/30be4af8-1f3e-4279-b157-1447b636e773" status: 200 len: 345 microversion: 2.1 time: 0.108899 Jun 07 14:21:21.787426 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 3/7] 10.222.0.81 () {58 vars in 1244 bytes} [Tue Jun 7 14:21:21 2022] GET /compute/v2.1/os-volumes/30be4af8-1f3e-4279-b157-1447b636e773 => generated 345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:21:21.792646 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-dbf60589-75d3-409d-8571-24e76167b140 tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003811 Jun 07 14:21:21.793153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 4/8] 10.222.0.81 () {58 vars in 1136 bytes} [Tue Jun 7 14:21:21 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 07 14:21:21.808470 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-466abacf-c51b-4a3b-b452-35e51e42aa21 tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] Calling method '.version_select at 0x7ff3853ad700>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:21.869210 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-466abacf-c51b-4a3b-b452-35e51e42aa21 tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] HTTP exception thrown: Volume 2c0e97d1-3a1e-4733-b42d-8cb3b06f9255 could not be found. Jun 07 14:21:21.877226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-466abacf-c51b-4a3b-b452-35e51e42aa21 tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] Request method failure captured: Jun 07 14:21:21.877226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: DELETE /compute/v2.1/os-volumes/2c0e97d1-3a1e-4733-b42d-8cb3b06f9255 HTTP/1.1 Jun 07 14:21:21.877226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:21:21.877226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:21:21.877226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:21:21.877226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:21:21.877226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:21:21.877226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:21:21.877226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:21:21.877226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:21:21.877226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin17eHJTqXilNbzR5J1BOzIFZhwGjXXkMXVoZwDyEzGN3i93F8vxnnrpXiOCv9f-YYSlpXb7I73YNULJixXl0JQnpRrEuUZHHG0wSCFGN1nWebd19m-cNbptD2cUehHAIdNd64yrwz571XO8eAPt-Yk1LNupmY8vAJmL9BPRwg5_i6t8 Jun 07 14:21:21.877226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:21:21.877226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:21:21.877226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:21:21.877226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:21:21.877226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:21:21.877226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:21:21.877226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: 95161229e3f14e42857866e55b39ec09 Jun 07 14:21:21.877226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-VolumesNegativeTest-1355482653 Jun 07 14:21:21.877226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:21:21.877226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:21:21.878918 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/95161229e3f14e42857866e55b39ec09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_95161229e3f14e42857866e55b39ec09", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/95161229e3f14e42857866e55b39ec09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/95161229e3f14e42857866e55b39ec09"}]}] Jun 07 14:21:21.878918 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-VolumesNegativeTest-1355482653 Jun 07 14:21:21.878918 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: 95161229e3f14e42857866e55b39ec09 Jun 07 14:21:21.878918 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-VolumesNegativeTest-1355482653 Jun 07 14:21:21.878918 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-VolumesNegativeTest-1355482653-project Jun 07 14:21:21.878918 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:21:21.878918 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:21:21.878918 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: 7411441cb9894116b5ec11dd1881146f Jun 07 14:21:21.878918 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-VolumesNegativeTest-1355482653-project Jun 07 14:21:21.878918 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: Jun 07 14:21:21.878918 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Volume 2c0e97d1-3a1e-4733-b42d-8cb3b06f9255 could not be found. Jun 07 14:21:21.878918 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': '2c0e97d1-3a1e-4733-b42d-8cb3b06f9255'} Jun 07 14:21:21.878918 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:21:21.880050 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:21.880050 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:21:21.880050 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:21:21.880050 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 14:21:21.880050 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 14:21:21.880050 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 14:21:21.880050 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 14:21:21.880050 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 14:21:21.880050 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 14:21:21.880050 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 14:21:21.880050 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 14:21:21.880050 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:21:21.880050 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:21:21.880050 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:21:21.880050 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:21:21.880050 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c0e97d1-3a1e-4733-b42d-8cb3b06f9255 could not be found. (HTTP 404) (Request-ID: req-579cc2dc-27e3-4108-9ecb-cd421705b41b) Jun 07 14:21:21.880050 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:21.880050 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:21.880050 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:21.881459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:21.881459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 14:21:21.881459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 14:21:21.881459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 14:21:21.881459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 14:21:21.881459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 14:21:21.881459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 14:21:21.881459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 14:21:21.881459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 14:21:21.881459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:21:21.881459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:21:21.881459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 14:21:21.881459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 14:21:21.881459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 14:21:21.881459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 14:21:21.881459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 14:21:21.881459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 14:21:21.881459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 14:21:21.881459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 14:21:21.882779 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:21:21.882779 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:21:21.882779 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:21:21.882779 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:21:21.882779 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c0e97d1-3a1e-4733-b42d-8cb3b06f9255 could not be found. Jun 07 14:21:21.882779 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:21.882779 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:21.882779 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:21.882779 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:21.882779 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:21:21.882779 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:21:21.882779 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:21:21.882779 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:21:21.882779 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 14:21:21.882779 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 14:21:21.882779 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:21:21.882779 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:21:21.882779 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 14:21:21.882779 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:21:21.885477 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c0e97d1-3a1e-4733-b42d-8cb3b06f9255 could not be found. Jun 07 14:21:21.885477 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:21.885477 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:21.885477 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:21.885477 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:21.885477 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:21:21.885477 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:21:21.885477 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:21:21.885477 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:21:21.885477 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c0e97d1-3a1e-4733-b42d-8cb3b06f9255 could not be found. Jun 07 14:21:21.885477 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:21.897560 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-466abacf-c51b-4a3b-b452-35e51e42aa21 tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] Returning 404 to user: Volume 2c0e97d1-3a1e-4733-b42d-8cb3b06f9255 could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:21:21.897560 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-466abacf-c51b-4a3b-b452-35e51e42aa21 tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/2c0e97d1-3a1e-4733-b42d-8cb3b06f9255" status: 404 len: 109 microversion: 2.1 time: 0.089212 Jun 07 14:21:21.897560 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 5/9] 10.222.0.81 () {58 vars in 1247 bytes} [Tue Jun 7 14:21:21 2022] DELETE /compute/v2.1/os-volumes/2c0e97d1-3a1e-4733-b42d-8cb3b06f9255 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:21:21.910682 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3791f50c-4d07-40b4-8e39-169685fae36e tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] Calling method '.version_select at 0x7ff385d93820>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:21.956887 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-3791f50c-4d07-40b4-8e39-169685fae36e tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] HTTP exception thrown: Volume 915925dd-a3d2-43c6-840b-387628c503a5 could not be found. Jun 07 14:21:21.959201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3791f50c-4d07-40b4-8e39-169685fae36e tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] Request method failure captured: Jun 07 14:21:21.959201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/os-volumes/915925dd-a3d2-43c6-840b-387628c503a5 HTTP/1.1 Jun 07 14:21:21.959201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:21:21.959201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:21:21.959201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:21:21.959201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:21:21.959201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:21:21.959201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:21:21.959201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:21:21.959201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:21:21.959201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin17eHJTqXilNbzR5J1BOzIFZhwGjXXkMXVoZwDyEzGN3i93F8vxnnrpXiOCv9f-YYSlpXb7I73YNULJixXl0JQnpRrEuUZHHG0wSCFGN1nWebd19m-cNbptD2cUehHAIdNd64yrwz571XO8eAPt-Yk1LNupmY8vAJmL9BPRwg5_i6t8 Jun 07 14:21:21.959201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:21:21.959201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:21:21.959201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:21:21.959201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:21:21.959201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:21:21.959201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:21:21.959201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: 95161229e3f14e42857866e55b39ec09 Jun 07 14:21:21.959201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-VolumesNegativeTest-1355482653 Jun 07 14:21:21.959201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:21:21.959201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:21:21.960789 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/95161229e3f14e42857866e55b39ec09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_95161229e3f14e42857866e55b39ec09", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/95161229e3f14e42857866e55b39ec09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/95161229e3f14e42857866e55b39ec09"}]}] Jun 07 14:21:21.960789 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-VolumesNegativeTest-1355482653 Jun 07 14:21:21.960789 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: 95161229e3f14e42857866e55b39ec09 Jun 07 14:21:21.960789 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-VolumesNegativeTest-1355482653 Jun 07 14:21:21.960789 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-VolumesNegativeTest-1355482653-project Jun 07 14:21:21.960789 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:21:21.960789 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:21:21.960789 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: 7411441cb9894116b5ec11dd1881146f Jun 07 14:21:21.960789 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-VolumesNegativeTest-1355482653-project Jun 07 14:21:21.960789 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: Jun 07 14:21:21.960789 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Volume 915925dd-a3d2-43c6-840b-387628c503a5 could not be found. Jun 07 14:21:21.960789 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': '915925dd-a3d2-43c6-840b-387628c503a5'} Jun 07 14:21:21.960789 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:21:21.961732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:21.961732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:21:21.961732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:21:21.961732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 14:21:21.961732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 14:21:21.961732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 14:21:21.961732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 14:21:21.961732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 14:21:21.961732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 14:21:21.961732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 14:21:21.961732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 14:21:21.961732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:21:21.961732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:21:21.961732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:21:21.961732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:21:21.961732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 915925dd-a3d2-43c6-840b-387628c503a5 could not be found. (HTTP 404) (Request-ID: req-00998d19-a031-4068-8e10-c8e9d2661bdf) Jun 07 14:21:21.961732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:21.961732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:21.961732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:21.963163 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:21.963163 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 14:21:21.963163 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 14:21:21.963163 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 14:21:21.963163 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 14:21:21.963163 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 14:21:21.963163 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 14:21:21.963163 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 14:21:21.963163 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 14:21:21.963163 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:21:21.963163 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:21:21.963163 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 14:21:21.963163 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 14:21:21.963163 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 14:21:21.963163 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 14:21:21.963163 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 14:21:21.963163 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 14:21:21.963163 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 14:21:21.963163 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 14:21:21.964540 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:21:21.964540 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:21:21.964540 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:21:21.964540 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:21:21.964540 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 915925dd-a3d2-43c6-840b-387628c503a5 could not be found. Jun 07 14:21:21.964540 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:21.964540 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:21.964540 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:21.964540 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:21.964540 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:21:21.964540 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:21:21.964540 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:21:21.964540 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:21:21.964540 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 14:21:21.964540 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 14:21:21.964540 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:21:21.964540 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:21:21.964540 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 14:21:21.964540 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:21:21.965819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 915925dd-a3d2-43c6-840b-387628c503a5 could not be found. Jun 07 14:21:21.965819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:21.965819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:21.965819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:21.965819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:21.965819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:21:21.965819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:21:21.965819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:21:21.965819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:21:21.965819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 915925dd-a3d2-43c6-840b-387628c503a5 could not be found. Jun 07 14:21:21.965819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:21.965819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3791f50c-4d07-40b4-8e39-169685fae36e tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] Returning 404 to user: Volume 915925dd-a3d2-43c6-840b-387628c503a5 could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:21:21.965819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-3791f50c-4d07-40b4-8e39-169685fae36e tempest-VolumesNegativeTest-1355482653 tempest-VolumesNegativeTest-1355482653-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/915925dd-a3d2-43c6-840b-387628c503a5" status: 404 len: 109 microversion: 2.1 time: 0.062080 Jun 07 14:21:21.965819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 6/10] 10.222.0.81 () {58 vars in 1244 bytes} [Tue Jun 7 14:21:21 2022] GET /compute/v2.1/os-volumes/915925dd-a3d2-43c6-840b-387628c503a5 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:21:22.800752 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-fcb2c291-f043-4f57-bebb-bf445b475288 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Calling method '.version_select at 0x7ff3853295e0>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:22.914594 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-fcb2c291-f043-4f57-bebb-bf445b475288 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/30be4af8-1f3e-4279-b157-1447b636e773" status: 200 len: 346 microversion: 2.1 time: 0.117909 Jun 07 14:21:22.923548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 7/11] 10.222.0.81 () {58 vars in 1244 bytes} [Tue Jun 7 14:21:22 2022] GET /compute/v2.1/os-volumes/30be4af8-1f3e-4279-b157-1447b636e773 => generated 346 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:21:22.930486 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-9d09ea4f-95e5-4e0e-bc78-7f0051903651 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Action: 'create', calling method: .version_select at 0x7ff385329c10>, body: {"snapshot": {"volume_id": "30be4af8-1f3e-4279-b157-1447b636e773", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-177121507"}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:21:23.377515 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-9d09ea4f-95e5-4e0e-bc78-7f0051903651 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] 10.222.0.81 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.452197 Jun 07 14:21:23.378095 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 8/12] 10.222.0.81 () {60 vars in 1161 bytes} [Tue Jun 7 14:21:22 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:21:23.387796 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-0f3b8755-3cee-4093-b803-1ae3996fa5b9 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Calling method '.version_select at 0x7ff385329160>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:23.478896 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-0f3b8755-3cee-4093-b803-1ae3996fa5b9 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/c6bbb84e-fe47-41c1-893d-56f8ca97fa93" status: 200 len: 286 microversion: 2.1 time: 0.094836 Jun 07 14:21:23.479898 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 9/13] 10.222.0.81 () {58 vars in 1250 bytes} [Tue Jun 7 14:21:23 2022] GET /compute/v2.1/os-snapshots/c6bbb84e-fe47-41c1-893d-56f8ca97fa93 => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:21:23.489895 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-63104d8c-e71b-4a5e-bd6f-862514cdcf16 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Calling method '.version_select at 0x7ff3853ad940>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:23.577141 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-63104d8c-e71b-4a5e-bd6f-862514cdcf16 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.091273 Jun 07 14:21:23.578528 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 10/14] 10.222.0.81 () {58 vars in 1139 bytes} [Tue Jun 7 14:21:23 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:21:23.589118 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-bdf49d5c-a0ec-4f2b-9add-ecfbd7d3837e tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Calling method '.version_select at 0x7ff3853335e0>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:23.738307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-bdf49d5c-a0ec-4f2b-9add-ecfbd7d3837e tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/c6bbb84e-fe47-41c1-893d-56f8ca97fa93" status: 200 len: 286 microversion: 2.1 time: 0.152844 Jun 07 14:21:23.739317 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 11/15] 10.222.0.81 () {58 vars in 1250 bytes} [Tue Jun 7 14:21:23 2022] GET /compute/v2.1/os-snapshots/c6bbb84e-fe47-41c1-893d-56f8ca97fa93 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:21:23.864110 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-a6ced98a-5004-4ea3-a09c-f15f01572d04 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Flavor limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:21:23.865130 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-a6ced98a-5004-4ea3-a09c-f15f01572d04 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Image limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:21:23.865902 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-a6ced98a-5004-4ea3-a09c-f15f01572d04 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Flavor pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:21:23.866453 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-a6ced98a-5004-4ea3-a09c-f15f01572d04 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Image pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:21:23.867009 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-a6ced98a-5004-4ea3-a09c-f15f01572d04 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:21:23.915035 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a6ced98a-5004-4ea3-a09c-f15f01572d04 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:23.915510 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a6ced98a-5004-4ea3-a09c-f15f01572d04 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:23.920383 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a6ced98a-5004-4ea3-a09c-f15f01572d04 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:23.931971 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a6ced98a-5004-4ea3-a09c-f15f01572d04 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:24.053408 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-a6ced98a-5004-4ea3-a09c-f15f01572d04 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Getting quotas for project 5da54606acd24962be630e28ff636d72. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:21:24.079634 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-a6ced98a-5004-4ea3-a09c-f15f01572d04 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Getting quotas for user 936db0436820496ebf8cc741852dda10 and project 5da54606acd24962be630e28ff636d72. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:21:24.120616 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a6ced98a-5004-4ea3-a09c-f15f01572d04 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Going to run 1 instances... {{(pid=117564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:21:24.125853 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a6ced98a-5004-4ea3-a09c-f15f01572d04 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2864004b-970a-480b-8453-14794f9ccca2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:21:24.348670 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a6ced98a-5004-4ea3-a09c-f15f01572d04 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.415118 Jun 07 14:21:24.354813 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 5/16] 10.222.0.81 () {60 vars in 1146 bytes} [Tue Jun 7 14:21:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:21:24.360554 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-f52ad30c-5083-4b62-947e-09995e2c4ae9 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:24.361317 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-f52ad30c-5083-4b62-947e-09995e2c4ae9 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:24.750930 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b81b5150-5969-45ec-83f3-239b2c99dd99 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Calling method '.version_select at 0x7ff38524c700>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:24.830486 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b81b5150-5969-45ec-83f3-239b2c99dd99 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/c6bbb84e-fe47-41c1-893d-56f8ca97fa93" status: 200 len: 286 microversion: 2.1 time: 0.084174 Jun 07 14:21:24.833556 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 6/17] 10.222.0.81 () {58 vars in 1250 bytes} [Tue Jun 7 14:21:24 2022] GET /compute/v2.1/os-snapshots/c6bbb84e-fe47-41c1-893d-56f8ca97fa93 => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:21:24.903517 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-f52ad30c-5083-4b62-947e-09995e2c4ae9 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:24.940821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-f52ad30c-5083-4b62-947e-09995e2c4ae9 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1214 microversion: 2.1 time: 0.582974 Jun 07 14:21:24.944915 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 12/18] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:24 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1214 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:25.842572 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-018b7e6f-98d2-40bf-a28e-1450f20db025 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Calling method '.version_select at 0x7ff38524ce50>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:25.904194 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-018b7e6f-98d2-40bf-a28e-1450f20db025 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/c6bbb84e-fe47-41c1-893d-56f8ca97fa93" status: 200 len: 286 microversion: 2.1 time: 0.066030 Jun 07 14:21:25.904981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 7/19] 10.222.0.81 () {58 vars in 1250 bytes} [Tue Jun 7 14:21:25 2022] GET /compute/v2.1/os-snapshots/c6bbb84e-fe47-41c1-893d-56f8ca97fa93 => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:21:25.959084 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7b5378ff-6eb7-45de-b40d-e804f065faa4 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:25.960790 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-7b5378ff-6eb7-45de-b40d-e804f065faa4 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:26.396442 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-7b5378ff-6eb7-45de-b40d-e804f065faa4 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:26.417282 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-7b5378ff-6eb7-45de-b40d-e804f065faa4 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1214 microversion: 2.1 time: 0.453285 Jun 07 14:21:26.428479 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 13/20] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:25 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1214 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:26.923706 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0a79c24f-1fed-438a-8810-50cf7c89feb0 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Calling method '.version_select at 0x7ff38524cd30>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:27.017038 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0a79c24f-1fed-438a-8810-50cf7c89feb0 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/c6bbb84e-fe47-41c1-893d-56f8ca97fa93" status: 200 len: 287 microversion: 2.1 time: 0.103147 Jun 07 14:21:27.027192 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 8/21] 10.222.0.81 () {58 vars in 1250 bytes} [Tue Jun 7 14:21:26 2022] GET /compute/v2.1/os-snapshots/c6bbb84e-fe47-41c1-893d-56f8ca97fa93 => generated 287 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:21:27.028962 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-9eb5bd17-b4be-44f7-874f-56a350f2c866 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Calling method '.version_select at 0x7ff3852ec9d0>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:27.228760 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-9eb5bd17-b4be-44f7-874f-56a350f2c866 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] 10.222.0.81 "DELETE /compute/v2.1/os-snapshots/c6bbb84e-fe47-41c1-893d-56f8ca97fa93" status: 202 len: 0 microversion: 2.1 time: 0.204249 Jun 07 14:21:27.229893 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 14/22] 10.222.0.81 () {58 vars in 1253 bytes} [Tue Jun 7 14:21:27 2022] DELETE /compute/v2.1/os-snapshots/c6bbb84e-fe47-41c1-893d-56f8ca97fa93 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:21:27.241006 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8b615fea-94e5-449f-b621-ddb1aad3bf08 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Calling method '.version_select at 0x7ff38524c670>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:27.305605 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8b615fea-94e5-449f-b621-ddb1aad3bf08 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/c6bbb84e-fe47-41c1-893d-56f8ca97fa93" status: 200 len: 286 microversion: 2.1 time: 0.070707 Jun 07 14:21:27.306218 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 9/23] 10.222.0.81 () {58 vars in 1250 bytes} [Tue Jun 7 14:21:27 2022] GET /compute/v2.1/os-snapshots/c6bbb84e-fe47-41c1-893d-56f8ca97fa93 => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:21:27.436870 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-2e9fdffd-7fca-4b26-9c8a-504cce9c259e tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:27.438284 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-2e9fdffd-7fca-4b26-9c8a-504cce9c259e tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:27.461327 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2e9fdffd-7fca-4b26-9c8a-504cce9c259e tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:27.461792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2e9fdffd-7fca-4b26-9c8a-504cce9c259e tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:27.465525 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2e9fdffd-7fca-4b26-9c8a-504cce9c259e tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:27.471508 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2e9fdffd-7fca-4b26-9c8a-504cce9c259e tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:27.897006 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-2e9fdffd-7fca-4b26-9c8a-504cce9c259e tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:27.946448 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-2e9fdffd-7fca-4b26-9c8a-504cce9c259e tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1266 microversion: 2.1 time: 0.511557 Jun 07 14:21:27.960455 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 15/24] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:27 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1266 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:28.319374 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5f19cda0-cdd0-4933-a36f-5442c61cecb8 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Calling method '.version_select at 0x7ff3841da280>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:28.385358 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-5f19cda0-cdd0-4933-a36f-5442c61cecb8 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] HTTP exception thrown: Snapshot c6bbb84e-fe47-41c1-893d-56f8ca97fa93 could not be found. Jun 07 14:21:28.397165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5f19cda0-cdd0-4933-a36f-5442c61cecb8 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Request method failure captured: Jun 07 14:21:28.397165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/os-snapshots/c6bbb84e-fe47-41c1-893d-56f8ca97fa93 HTTP/1.1 Jun 07 14:21:28.397165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 07 14:21:28.397165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 07 14:21:28.397165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Connection: close Jun 07 14:21:28.397165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 07 14:21:28.397165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 07 14:21:28.397165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Host: 10.222.0.81 Jun 07 14:21:28.397165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 07 14:21:28.397165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 07 14:21:28.397165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABin17dPPAhcQPt0MBQF08p5zyWmYTMFM72NV-zsh_DSVFTak2JhEpJFiRAOAjzJrbHb0ujSHqfJ1x9Nx6D-GCnlBU2YduGHrYc82CcH7bsWH50eUG15INSutyEwl6N2eV3NMi_sBJ7qKWFCaJNR32RaxbWmUqX9r-NISMqlmN6XmYNf2o Jun 07 14:21:28.397165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 07 14:21:28.397165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 07 14:21:28.397165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 07 14:21:28.397165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 07 14:21:28.397165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 07 14:21:28.397165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 07 14:21:28.397165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Id: 59eff67373ac4a7091ee20065a20bea2 Jun 07 14:21:28.397165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1312864589 Jun 07 14:21:28.397165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Role: member,reader Jun 07 14:21:28.397165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Roles: member,reader Jun 07 14:21:28.398289 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/59eff67373ac4a7091ee20065a20bea2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_59eff67373ac4a7091ee20065a20bea2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/59eff67373ac4a7091ee20065a20bea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/59eff67373ac4a7091ee20065a20bea2"}]}] Jun 07 14:21:28.398289 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1312864589 Jun 07 14:21:28.398289 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 59eff67373ac4a7091ee20065a20bea2 Jun 07 14:21:28.398289 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1312864589 Jun 07 14:21:28.398289 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User: tempest-VolumesSnapshotsTestJSON-1312864589-project Jun 07 14:21:28.398289 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 07 14:21:28.398289 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 07 14:21:28.398289 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Id: 8e440699aceb4636bb68e796e811e758 Jun 07 14:21:28.398289 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1312864589-project Jun 07 14:21:28.398289 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: method: Jun 07 14:21:28.398289 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: exception: Snapshot c6bbb84e-fe47-41c1-893d-56f8ca97fa93 could not be found. Jun 07 14:21:28.398289 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: action_args: {'id': 'c6bbb84e-fe47-41c1-893d-56f8ca97fa93'} Jun 07 14:21:28.398289 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:21:28.399040 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:28.399040 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 07 14:21:28.399040 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 07 14:21:28.399040 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 07 14:21:28.399040 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 07 14:21:28.399040 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 07 14:21:28.399040 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 07 14:21:28.399040 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 14:21:28.399040 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 14:21:28.399040 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 14:21:28.399040 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 14:21:28.399040 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:21:28.399040 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:21:28.399040 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:21:28.399040 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:21:28.399040 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c6bbb84e-fe47-41c1-893d-56f8ca97fa93 could not be found. (HTTP 404) (Request-ID: req-e1eb0ae3-6906-4765-98fe-0e4b4c850732) Jun 07 14:21:28.399040 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:28.399040 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:28.400063 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:28.400063 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:28.400063 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 07 14:21:28.400063 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 07 14:21:28.400063 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 14:21:28.400063 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 14:21:28.400063 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 07 14:21:28.400063 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 07 14:21:28.400063 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 14:21:28.400063 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 14:21:28.400063 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 07 14:21:28.400063 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 07 14:21:28.400063 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 07 14:21:28.400063 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 07 14:21:28.400063 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 07 14:21:28.400063 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 07 14:21:28.400063 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 14:21:28.400063 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 14:21:28.400063 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 14:21:28.401150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 14:21:28.401150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:21:28.401150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:21:28.401150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:21:28.401150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:21:28.401150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c6bbb84e-fe47-41c1-893d-56f8ca97fa93 could not be found. Jun 07 14:21:28.401150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:28.401150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:28.401150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:28.401150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:28.401150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:21:28.401150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:21:28.401150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:21:28.401150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:21:28.401150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 14:21:28.401150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 14:21:28.401150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:21:28.401150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:21:28.401150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 07 14:21:28.401150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:21:28.402208 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c6bbb84e-fe47-41c1-893d-56f8ca97fa93 could not be found. Jun 07 14:21:28.402208 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:28.402208 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:28.402208 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:28.402208 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:28.402208 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:21:28.402208 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:21:28.402208 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:21:28.402208 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:21:28.402208 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c6bbb84e-fe47-41c1-893d-56f8ca97fa93 could not be found. Jun 07 14:21:28.402208 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:21:28.402208 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5f19cda0-cdd0-4933-a36f-5442c61cecb8 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Returning 404 to user: Snapshot c6bbb84e-fe47-41c1-893d-56f8ca97fa93 could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:21:28.402208 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-5f19cda0-cdd0-4933-a36f-5442c61cecb8 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/c6bbb84e-fe47-41c1-893d-56f8ca97fa93" status: 404 len: 111 microversion: 2.1 time: 0.084988 Jun 07 14:21:28.404378 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 10/25] 10.222.0.81 () {58 vars in 1250 bytes} [Tue Jun 7 14:21:28 2022] GET /compute/v2.1/os-snapshots/c6bbb84e-fe47-41c1-893d-56f8ca97fa93 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:21:28.413741 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-fae47816-ef29-4eb7-9bb8-113dc52b4005 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Calling method '.version_select at 0x7ff3852709d0>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:28.594952 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-fae47816-ef29-4eb7-9bb8-113dc52b4005 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/30be4af8-1f3e-4279-b157-1447b636e773" status: 202 len: 0 microversion: 2.1 time: 0.185483 Jun 07 14:21:28.596635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 16/26] 10.222.0.81 () {58 vars in 1247 bytes} [Tue Jun 7 14:21:28 2022] DELETE /compute/v2.1/os-volumes/30be4af8-1f3e-4279-b157-1447b636e773 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:21:28.604709 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9d1ad117-24da-48eb-ac2a-8bc95940e5c6 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Calling method '.version_select at 0x7ff38524ca60>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:28.809343 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9d1ad117-24da-48eb-ac2a-8bc95940e5c6 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/30be4af8-1f3e-4279-b157-1447b636e773" status: 200 len: 345 microversion: 2.1 time: 0.209026 Jun 07 14:21:28.811393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 11/27] 10.222.0.81 () {58 vars in 1244 bytes} [Tue Jun 7 14:21:28 2022] GET /compute/v2.1/os-volumes/30be4af8-1f3e-4279-b157-1447b636e773 => generated 345 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:21:28.967521 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-53ce6ee4-c1e7-4f9b-8de4-2e2bf54de050 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:28.968208 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-53ce6ee4-c1e7-4f9b-8de4-2e2bf54de050 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:28.981096 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-53ce6ee4-c1e7-4f9b-8de4-2e2bf54de050 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:28.981938 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-53ce6ee4-c1e7-4f9b-8de4-2e2bf54de050 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:28.982785 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-53ce6ee4-c1e7-4f9b-8de4-2e2bf54de050 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:28.983175 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-53ce6ee4-c1e7-4f9b-8de4-2e2bf54de050 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:29.200478 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-53ce6ee4-c1e7-4f9b-8de4-2e2bf54de050 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:29.222201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-53ce6ee4-c1e7-4f9b-8de4-2e2bf54de050 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1272 microversion: 2.1 time: 0.260983 Jun 07 14:21:29.231281 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 17/28] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:28 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1272 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:21:29.832367 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-30780eb7-6ec9-4c44-a5cb-663d3fde0547 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Calling method '.version_select at 0x7ff385221ee0>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:29.993179 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-30780eb7-6ec9-4c44-a5cb-663d3fde0547 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] HTTP exception thrown: Volume 30be4af8-1f3e-4279-b157-1447b636e773 could not be found. Jun 07 14:21:29.995681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-30780eb7-6ec9-4c44-a5cb-663d3fde0547 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Request method failure captured: Jun 07 14:21:29.995681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/os-volumes/30be4af8-1f3e-4279-b157-1447b636e773 HTTP/1.1 Jun 07 14:21:29.995681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:21:29.995681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:21:29.995681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:21:29.995681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:21:29.995681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:21:29.995681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:21:29.995681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:21:29.995681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:21:29.995681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin17dPPAhcQPt0MBQF08p5zyWmYTMFM72NV-zsh_DSVFTak2JhEpJFiRAOAjzJrbHb0ujSHqfJ1x9Nx6D-GCnlBU2YduGHrYc82CcH7bsWH50eUG15INSutyEwl6N2eV3NMi_sBJ7qKWFCaJNR32RaxbWmUqX9r-NISMqlmN6XmYNf2o Jun 07 14:21:29.995681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:21:29.995681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:21:29.995681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:21:29.995681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:21:29.995681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:21:29.995681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:21:29.995681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: 59eff67373ac4a7091ee20065a20bea2 Jun 07 14:21:29.995681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1312864589 Jun 07 14:21:29.995681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:21:29.995681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:21:29.996755 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/59eff67373ac4a7091ee20065a20bea2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_59eff67373ac4a7091ee20065a20bea2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/59eff67373ac4a7091ee20065a20bea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/59eff67373ac4a7091ee20065a20bea2"}]}] Jun 07 14:21:29.996755 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1312864589 Jun 07 14:21:29.996755 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: 59eff67373ac4a7091ee20065a20bea2 Jun 07 14:21:29.996755 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1312864589 Jun 07 14:21:29.996755 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-VolumesSnapshotsTestJSON-1312864589-project Jun 07 14:21:29.996755 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:21:29.996755 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:21:29.996755 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: 8e440699aceb4636bb68e796e811e758 Jun 07 14:21:29.996755 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1312864589-project Jun 07 14:21:29.996755 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: Jun 07 14:21:29.996755 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Volume 30be4af8-1f3e-4279-b157-1447b636e773 could not be found. Jun 07 14:21:29.996755 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': '30be4af8-1f3e-4279-b157-1447b636e773'} Jun 07 14:21:29.996755 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:21:29.997373 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:29.997373 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:21:29.997373 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:21:29.997373 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 14:21:29.997373 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 14:21:29.997373 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 14:21:29.997373 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 14:21:29.997373 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 14:21:29.997373 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 14:21:29.997373 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 14:21:29.997373 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 14:21:29.997373 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:21:29.997373 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:21:29.997373 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:21:29.997373 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:21:29.997373 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 30be4af8-1f3e-4279-b157-1447b636e773 could not be found. (HTTP 404) (Request-ID: req-2dd82183-ff0d-4b1c-a840-328e24044052) Jun 07 14:21:29.997373 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:29.997373 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:29.997373 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:29.998240 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:29.998240 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 14:21:29.998240 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 14:21:29.998240 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 14:21:29.998240 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 14:21:29.998240 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 14:21:29.998240 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 14:21:29.998240 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 14:21:29.998240 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 14:21:29.998240 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:21:29.998240 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:21:29.998240 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 14:21:29.998240 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 14:21:29.998240 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 14:21:29.998240 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 14:21:29.998240 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 14:21:29.998240 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 14:21:29.998240 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 14:21:29.998240 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 14:21:29.999237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:21:29.999237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:21:29.999237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:21:29.999237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:21:29.999237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 30be4af8-1f3e-4279-b157-1447b636e773 could not be found. Jun 07 14:21:29.999237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:29.999237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:29.999237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:29.999237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:29.999237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:21:29.999237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:21:29.999237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:21:29.999237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:21:29.999237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 14:21:29.999237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 14:21:29.999237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:21:29.999237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:21:29.999237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 14:21:29.999237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:21:30.000319 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 30be4af8-1f3e-4279-b157-1447b636e773 could not be found. Jun 07 14:21:30.000319 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:30.000319 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:30.000319 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:30.000319 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:30.000319 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:21:30.000319 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:21:30.000319 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:21:30.000319 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:21:30.000319 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 30be4af8-1f3e-4279-b157-1447b636e773 could not be found. Jun 07 14:21:30.000319 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:30.006707 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-30780eb7-6ec9-4c44-a5cb-663d3fde0547 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Returning 404 to user: Volume 30be4af8-1f3e-4279-b157-1447b636e773 could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:21:30.007827 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-30780eb7-6ec9-4c44-a5cb-663d3fde0547 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/30be4af8-1f3e-4279-b157-1447b636e773" status: 404 len: 109 microversion: 2.1 time: 0.188411 Jun 07 14:21:30.014620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 18/29] 10.222.0.81 () {58 vars in 1244 bytes} [Tue Jun 7 14:21:29 2022] GET /compute/v2.1/os-volumes/30be4af8-1f3e-4279-b157-1447b636e773 => generated 109 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:21:30.034548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-4a024102-8050-41bf-b5c5-33b5d65d3676 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Calling method '.version_select at 0x7ff385270c10>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:30.102579 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-4a024102-8050-41bf-b5c5-33b5d65d3676 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] HTTP exception thrown: Volume 30be4af8-1f3e-4279-b157-1447b636e773 could not be found. Jun 07 14:21:30.106965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-4a024102-8050-41bf-b5c5-33b5d65d3676 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Request method failure captured: Jun 07 14:21:30.106965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: DELETE /compute/v2.1/os-volumes/30be4af8-1f3e-4279-b157-1447b636e773 HTTP/1.1 Jun 07 14:21:30.106965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:21:30.106965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:21:30.106965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:21:30.106965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:21:30.106965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:21:30.106965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:21:30.106965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:21:30.106965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:21:30.106965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin17dPPAhcQPt0MBQF08p5zyWmYTMFM72NV-zsh_DSVFTak2JhEpJFiRAOAjzJrbHb0ujSHqfJ1x9Nx6D-GCnlBU2YduGHrYc82CcH7bsWH50eUG15INSutyEwl6N2eV3NMi_sBJ7qKWFCaJNR32RaxbWmUqX9r-NISMqlmN6XmYNf2o Jun 07 14:21:30.106965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:21:30.106965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:21:30.106965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:21:30.106965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:21:30.106965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:21:30.106965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:21:30.106965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: 59eff67373ac4a7091ee20065a20bea2 Jun 07 14:21:30.106965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1312864589 Jun 07 14:21:30.106965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:21:30.106965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:21:30.109032 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/59eff67373ac4a7091ee20065a20bea2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_59eff67373ac4a7091ee20065a20bea2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/59eff67373ac4a7091ee20065a20bea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/59eff67373ac4a7091ee20065a20bea2"}]}] Jun 07 14:21:30.109032 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1312864589 Jun 07 14:21:30.109032 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: 59eff67373ac4a7091ee20065a20bea2 Jun 07 14:21:30.109032 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1312864589 Jun 07 14:21:30.109032 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-VolumesSnapshotsTestJSON-1312864589-project Jun 07 14:21:30.109032 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:21:30.109032 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:21:30.109032 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: 8e440699aceb4636bb68e796e811e758 Jun 07 14:21:30.109032 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1312864589-project Jun 07 14:21:30.109032 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: Jun 07 14:21:30.109032 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Volume 30be4af8-1f3e-4279-b157-1447b636e773 could not be found. Jun 07 14:21:30.109032 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': '30be4af8-1f3e-4279-b157-1447b636e773'} Jun 07 14:21:30.109032 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:21:30.109672 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:30.109672 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:21:30.109672 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:21:30.109672 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 14:21:30.109672 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 14:21:30.109672 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 14:21:30.109672 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 14:21:30.109672 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 14:21:30.109672 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 14:21:30.109672 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 14:21:30.109672 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 14:21:30.109672 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:21:30.109672 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:21:30.109672 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:21:30.109672 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:21:30.109672 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 30be4af8-1f3e-4279-b157-1447b636e773 could not be found. (HTTP 404) (Request-ID: req-8df3f3f0-e2fc-4a71-9c52-9a296acb3f80) Jun 07 14:21:30.109672 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:30.109672 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:30.109672 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:30.111736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:30.111736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 14:21:30.111736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 14:21:30.111736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 14:21:30.111736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 14:21:30.111736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 14:21:30.111736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 14:21:30.111736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 14:21:30.111736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 14:21:30.111736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:21:30.111736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:21:30.111736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 14:21:30.111736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 14:21:30.111736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 14:21:30.111736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 14:21:30.111736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 14:21:30.111736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 14:21:30.111736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 14:21:30.111736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 14:21:30.114209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:21:30.114209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:21:30.114209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:21:30.114209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:21:30.114209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 30be4af8-1f3e-4279-b157-1447b636e773 could not be found. Jun 07 14:21:30.114209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:30.114209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:30.114209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:30.114209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:30.114209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:21:30.114209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:21:30.114209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:21:30.114209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:21:30.114209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 14:21:30.114209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 14:21:30.114209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:21:30.114209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:21:30.114209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 14:21:30.114209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:21:30.116689 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 30be4af8-1f3e-4279-b157-1447b636e773 could not be found. Jun 07 14:21:30.116689 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:30.116689 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:30.116689 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:30.116689 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:30.116689 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:21:30.116689 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:21:30.116689 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:21:30.116689 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:21:30.116689 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 30be4af8-1f3e-4279-b157-1447b636e773 could not be found. Jun 07 14:21:30.116689 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:30.120493 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-4a024102-8050-41bf-b5c5-33b5d65d3676 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Returning 404 to user: Volume 30be4af8-1f3e-4279-b157-1447b636e773 could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:21:30.121804 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-4a024102-8050-41bf-b5c5-33b5d65d3676 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/30be4af8-1f3e-4279-b157-1447b636e773" status: 404 len: 109 microversion: 2.1 time: 0.103219 Jun 07 14:21:30.126468 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 19/30] 10.222.0.81 () {58 vars in 1247 bytes} [Tue Jun 7 14:21:30 2022] DELETE /compute/v2.1/os-volumes/30be4af8-1f3e-4279-b157-1447b636e773 => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:21:30.136412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-c2b2d294-8c9e-41d8-bccc-38721f1652d7 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Calling method '.version_select at 0x7ff385d93820>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:30.183294 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-334de806-e36e-4c7f-83ea-f2836a6d256b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1685885543", "imageRef": "2864004b-970a-480b-8453-14794f9ccca2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:21:30.232960 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-c2b2d294-8c9e-41d8-bccc-38721f1652d7 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] HTTP exception thrown: Volume 30be4af8-1f3e-4279-b157-1447b636e773 could not be found. Jun 07 14:21:30.237652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-c2b2d294-8c9e-41d8-bccc-38721f1652d7 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Request method failure captured: Jun 07 14:21:30.237652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/os-volumes/30be4af8-1f3e-4279-b157-1447b636e773 HTTP/1.1 Jun 07 14:21:30.237652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:21:30.237652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:21:30.237652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:21:30.237652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:21:30.237652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:21:30.237652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:21:30.237652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:21:30.237652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:21:30.237652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin17dPPAhcQPt0MBQF08p5zyWmYTMFM72NV-zsh_DSVFTak2JhEpJFiRAOAjzJrbHb0ujSHqfJ1x9Nx6D-GCnlBU2YduGHrYc82CcH7bsWH50eUG15INSutyEwl6N2eV3NMi_sBJ7qKWFCaJNR32RaxbWmUqX9r-NISMqlmN6XmYNf2o Jun 07 14:21:30.237652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:21:30.237652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:21:30.237652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:21:30.237652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:21:30.237652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:21:30.237652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:21:30.237652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: 59eff67373ac4a7091ee20065a20bea2 Jun 07 14:21:30.237652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1312864589 Jun 07 14:21:30.237652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:21:30.237652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:21:30.238766 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/59eff67373ac4a7091ee20065a20bea2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_59eff67373ac4a7091ee20065a20bea2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/59eff67373ac4a7091ee20065a20bea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/59eff67373ac4a7091ee20065a20bea2"}]}] Jun 07 14:21:30.238766 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1312864589 Jun 07 14:21:30.238766 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: 59eff67373ac4a7091ee20065a20bea2 Jun 07 14:21:30.238766 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1312864589 Jun 07 14:21:30.238766 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-VolumesSnapshotsTestJSON-1312864589-project Jun 07 14:21:30.238766 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:21:30.238766 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:21:30.238766 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: 8e440699aceb4636bb68e796e811e758 Jun 07 14:21:30.238766 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1312864589-project Jun 07 14:21:30.238766 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: Jun 07 14:21:30.238766 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Volume 30be4af8-1f3e-4279-b157-1447b636e773 could not be found. Jun 07 14:21:30.238766 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': '30be4af8-1f3e-4279-b157-1447b636e773'} Jun 07 14:21:30.238766 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:21:30.239401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:30.239401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:21:30.239401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:21:30.239401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 14:21:30.239401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 14:21:30.239401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 14:21:30.239401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 14:21:30.239401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 14:21:30.239401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 14:21:30.239401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 14:21:30.239401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 14:21:30.239401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:21:30.239401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:21:30.239401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:21:30.239401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:21:30.239401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 30be4af8-1f3e-4279-b157-1447b636e773 could not be found. (HTTP 404) (Request-ID: req-4e17bef7-59b3-4975-a100-87d6ff6ceb9f) Jun 07 14:21:30.239401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:30.239401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:30.239401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:30.240334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:30.240334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 14:21:30.240334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 14:21:30.240334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 14:21:30.240334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 14:21:30.240334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 14:21:30.240334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 14:21:30.240334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 14:21:30.240334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 14:21:30.240334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:21:30.240334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:21:30.240334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 14:21:30.240334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 14:21:30.240334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 14:21:30.240334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 14:21:30.240334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 14:21:30.240334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 14:21:30.240334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 14:21:30.240334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 14:21:30.241284 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:21:30.241284 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:21:30.241284 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:21:30.241284 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:21:30.241284 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 30be4af8-1f3e-4279-b157-1447b636e773 could not be found. Jun 07 14:21:30.241284 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:30.241284 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:30.241284 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:30.241284 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:30.241284 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:21:30.241284 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:21:30.241284 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:21:30.241284 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:21:30.241284 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 14:21:30.241284 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 14:21:30.241284 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:21:30.241284 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:21:30.241284 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 14:21:30.241284 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:21:30.242194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 30be4af8-1f3e-4279-b157-1447b636e773 could not be found. Jun 07 14:21:30.242194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:30.242194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:30.242194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:30.242194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:30.242194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:21:30.242194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:21:30.242194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:21:30.242194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:21:30.242194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 30be4af8-1f3e-4279-b157-1447b636e773 could not be found. Jun 07 14:21:30.242194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:30.248277 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-c2b2d294-8c9e-41d8-bccc-38721f1652d7 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] Returning 404 to user: Volume 30be4af8-1f3e-4279-b157-1447b636e773 could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:21:30.250252 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-c2b2d294-8c9e-41d8-bccc-38721f1652d7 tempest-VolumesSnapshotsTestJSON-1312864589 tempest-VolumesSnapshotsTestJSON-1312864589-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/30be4af8-1f3e-4279-b157-1447b636e773" status: 404 len: 109 microversion: 2.1 time: 0.122262 Jun 07 14:21:30.256346 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 20/31] 10.222.0.81 () {58 vars in 1244 bytes} [Tue Jun 7 14:21:30 2022] GET /compute/v2.1/os-volumes/30be4af8-1f3e-4279-b157-1447b636e773 => generated 109 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:21:30.265959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-6b419260-9a38-4f31-9c32-977dd8f66276 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:30.267000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-6b419260-9a38-4f31-9c32-977dd8f66276 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:30.277251 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6b419260-9a38-4f31-9c32-977dd8f66276 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:30.278290 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6b419260-9a38-4f31-9c32-977dd8f66276 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:30.279705 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6b419260-9a38-4f31-9c32-977dd8f66276 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:30.280816 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6b419260-9a38-4f31-9c32-977dd8f66276 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:30.323605 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.network.neutron [None req-334de806-e36e-4c7f-83ea-f2836a6d256b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] validate_networks() for [('e29f253b-76e1-40c6-9128-7a3556b521e2', None, None, None, None, None)] {{(pid=117564) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:21:30.518951 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-6b419260-9a38-4f31-9c32-977dd8f66276 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:30.534431 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-6b419260-9a38-4f31-9c32-977dd8f66276 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1272 microversion: 2.1 time: 0.274281 Jun 07 14:21:30.537394 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 21/32] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:30 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1272 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:31.557995 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-9bb2907d-0f32-4c1b-9a29-6e899f1cc264 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:31.562670 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-9bb2907d-0f32-4c1b-9a29-6e899f1cc264 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:31.572687 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9bb2907d-0f32-4c1b-9a29-6e899f1cc264 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:31.576235 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9bb2907d-0f32-4c1b-9a29-6e899f1cc264 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:31.580468 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9bb2907d-0f32-4c1b-9a29-6e899f1cc264 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:31.582650 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9bb2907d-0f32-4c1b-9a29-6e899f1cc264 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:31.829097 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-9bb2907d-0f32-4c1b-9a29-6e899f1cc264 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:31.859036 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-9bb2907d-0f32-4c1b-9a29-6e899f1cc264 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1272 microversion: 2.1 time: 0.303818 Jun 07 14:21:31.862843 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 22/33] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:31 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1272 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:32.879694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-c83d59ca-bc26-44e4-bdb3-e80de3744904 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:32.880355 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-c83d59ca-bc26-44e4-bdb3-e80de3744904 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:32.896800 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c83d59ca-bc26-44e4-bdb3-e80de3744904 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:32.897136 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c83d59ca-bc26-44e4-bdb3-e80de3744904 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:32.903442 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c83d59ca-bc26-44e4-bdb3-e80de3744904 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:32.904626 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c83d59ca-bc26-44e4-bdb3-e80de3744904 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:33.936945 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-334de806-e36e-4c7f-83ea-f2836a6d256b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Flavor limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:21:33.937601 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-334de806-e36e-4c7f-83ea-f2836a6d256b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Image limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:21:33.938837 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-334de806-e36e-4c7f-83ea-f2836a6d256b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Flavor pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:21:33.939469 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-334de806-e36e-4c7f-83ea-f2836a6d256b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Image pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:21:33.940005 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-334de806-e36e-4c7f-83ea-f2836a6d256b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:21:34.003916 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-334de806-e36e-4c7f-83ea-f2836a6d256b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:34.004382 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-334de806-e36e-4c7f-83ea-f2836a6d256b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:34.005305 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-334de806-e36e-4c7f-83ea-f2836a6d256b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:34.005971 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-334de806-e36e-4c7f-83ea-f2836a6d256b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:34.023378 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:34.042503 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:34.151029 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-334de806-e36e-4c7f-83ea-f2836a6d256b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Getting quotas for project ec8e48464f6a4d1886aaf89cc8b28e5f. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:21:34.187402 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-334de806-e36e-4c7f-83ea-f2836a6d256b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Getting quotas for user d20025ab12f4450da20c8e41b931b5fc and project ec8e48464f6a4d1886aaf89cc8b28e5f. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:21:34.242533 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-334de806-e36e-4c7f-83ea-f2836a6d256b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Going to run 1 instances... {{(pid=117564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:21:34.248339 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-334de806-e36e-4c7f-83ea-f2836a6d256b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2864004b-970a-480b-8453-14794f9ccca2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:21:34.253988 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-c83d59ca-bc26-44e4-bdb3-e80de3744904 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:34.286473 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-c83d59ca-bc26-44e4-bdb3-e80de3744904 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 1.410901 Jun 07 14:21:34.297395 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 23/34] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:32 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:34.398115 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-334de806-e36e-4c7f-83ea-f2836a6d256b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.709564 Jun 07 14:21:34.399690 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 12/35] 10.222.0.81 () {60 vars in 1146 bytes} [Tue Jun 7 14:21:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 4712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:21:34.423021 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3a79b346-4760-4338-88eb-c350cfe6e9b0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:34.425598 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-3a79b346-4760-4338-88eb-c350cfe6e9b0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:34.564373 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-3a79b346-4760-4338-88eb-c350cfe6e9b0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:34.586951 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-3a79b346-4760-4338-88eb-c350cfe6e9b0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1222 microversion: 2.1 time: 0.177432 Jun 07 14:21:34.603301 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 24/36] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:34 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1222 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:35.115864 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-74222efa-c423-45d6-afc2-2d2be5ab9d3e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-40791037", "imageRef": "2864004b-970a-480b-8453-14794f9ccca2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:21:35.239575 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.network.neutron [None req-74222efa-c423-45d6-afc2-2d2be5ab9d3e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] validate_networks() for [('e29f253b-76e1-40c6-9128-7a3556b521e2', None, None, None, None, None)] {{(pid=117564) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:21:35.317855 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7d85d3b4-f45f-44a1-b3cd-3c3522952aa6 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:35.320771 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-7d85d3b4-f45f-44a1-b3cd-3c3522952aa6 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:35.342014 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7d85d3b4-f45f-44a1-b3cd-3c3522952aa6 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:35.342612 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7d85d3b4-f45f-44a1-b3cd-3c3522952aa6 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:35.343513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7d85d3b4-f45f-44a1-b3cd-3c3522952aa6 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:35.343960 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7d85d3b4-f45f-44a1-b3cd-3c3522952aa6 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:36.415451 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-7d85d3b4-f45f-44a1-b3cd-3c3522952aa6 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:36.456068 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-7d85d3b4-f45f-44a1-b3cd-3c3522952aa6 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 1.137355 Jun 07 14:21:36.456809 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 25/37] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:35 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:21:37.475269 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-de04872f-0c18-4914-becd-18b057277e7d tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:37.477270 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-de04872f-0c18-4914-becd-18b057277e7d tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:37.492635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-de04872f-0c18-4914-becd-18b057277e7d tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:37.497166 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-de04872f-0c18-4914-becd-18b057277e7d tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:37.502935 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-de04872f-0c18-4914-becd-18b057277e7d tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:37.503859 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-de04872f-0c18-4914-becd-18b057277e7d tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:37.510102 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-74222efa-c423-45d6-afc2-2d2be5ab9d3e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Flavor limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:21:37.510643 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-74222efa-c423-45d6-afc2-2d2be5ab9d3e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Image limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:21:37.511136 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-74222efa-c423-45d6-afc2-2d2be5ab9d3e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Flavor pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:21:37.511590 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-74222efa-c423-45d6-afc2-2d2be5ab9d3e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Image pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:21:37.511999 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-74222efa-c423-45d6-afc2-2d2be5ab9d3e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:21:37.553824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-74222efa-c423-45d6-afc2-2d2be5ab9d3e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:37.556389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-74222efa-c423-45d6-afc2-2d2be5ab9d3e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:37.559434 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-74222efa-c423-45d6-afc2-2d2be5ab9d3e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:37.564542 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-74222efa-c423-45d6-afc2-2d2be5ab9d3e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:37.631181 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-74222efa-c423-45d6-afc2-2d2be5ab9d3e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Getting quotas for project ec8e48464f6a4d1886aaf89cc8b28e5f. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:21:37.638280 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-74222efa-c423-45d6-afc2-2d2be5ab9d3e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Getting quotas for user d20025ab12f4450da20c8e41b931b5fc and project ec8e48464f6a4d1886aaf89cc8b28e5f. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:21:37.665861 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-74222efa-c423-45d6-afc2-2d2be5ab9d3e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Going to run 1 instances... {{(pid=117564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:21:37.672494 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-74222efa-c423-45d6-afc2-2d2be5ab9d3e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2864004b-970a-480b-8453-14794f9ccca2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:21:37.773895 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-74222efa-c423-45d6-afc2-2d2be5ab9d3e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.663123 Jun 07 14:21:37.783441 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 13/38] 10.222.0.81 () {60 vars in 1146 bytes} [Tue Jun 7 14:21:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 2674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:21:37.802090 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-adcd23e4-401d-44d0-b987-97400ab1c5d3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:37.802846 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-adcd23e4-401d-44d0-b987-97400ab1c5d3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:38.114908 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-adcd23e4-401d-44d0-b987-97400ab1c5d3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:38.140527 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-adcd23e4-401d-44d0-b987-97400ab1c5d3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1220 microversion: 2.1 time: 0.355673 Jun 07 14:21:38.141537 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 14/39] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:37 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1220 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:38.242407 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-de04872f-0c18-4914-becd-18b057277e7d tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:38.260005 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-de04872f-0c18-4914-becd-18b057277e7d tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 0.784638 Jun 07 14:21:38.267349 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 26/40] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:37 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:39.170202 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-30e345ae-feeb-48e6-abdc-a380296ca5c5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:39.172137 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-30e345ae-feeb-48e6-abdc-a380296ca5c5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:39.189549 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-30e345ae-feeb-48e6-abdc-a380296ca5c5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:39.190792 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-30e345ae-feeb-48e6-abdc-a380296ca5c5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:39.206216 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-30e345ae-feeb-48e6-abdc-a380296ca5c5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:39.208998 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-30e345ae-feeb-48e6-abdc-a380296ca5c5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:39.293832 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-8299c56f-5dbb-4176-9971-139956a94498 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:39.298528 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-8299c56f-5dbb-4176-9971-139956a94498 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:39.353675 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8299c56f-5dbb-4176-9971-139956a94498 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:39.354260 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8299c56f-5dbb-4176-9971-139956a94498 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:39.373346 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8299c56f-5dbb-4176-9971-139956a94498 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:39.377712 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8299c56f-5dbb-4176-9971-139956a94498 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:39.778246 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-30e345ae-feeb-48e6-abdc-a380296ca5c5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:39.803935 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-30e345ae-feeb-48e6-abdc-a380296ca5c5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1216 microversion: 2.1 time: 0.639604 Jun 07 14:21:39.804506 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 15/41] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:39 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1216 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:39.927794 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8299c56f-5dbb-4176-9971-139956a94498 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:39.936253 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-8299c56f-5dbb-4176-9971-139956a94498 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 0.655651 Jun 07 14:21:39.940821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 27/42] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:39 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:21:40.400396 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8c3ba17a-1405-4442-866f-0595018b2148 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Action: 'create', calling method: .version_select at 0x7ff38417f820>, body: {"keypair": {"name": "tempest-keypair-639870198", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbvXMe4+lEyrOjlkLIl11YZmSCZgGpH9AJEg46FapqDPvZm2zAAto/J68aIPBN4+uTWcp+7AZ5HdRDhGZo0QXJK44BHp9zwGZBHLwysXc17RNBFkxTG3s0l2yWnm6cfwg=="}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:21:40.426421 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-8c3ba17a-1405-4442-866f-0595018b2148 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Getting quotas for project 798b460fbb2e4be69df7f5f419844832. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:21:40.432355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-8c3ba17a-1405-4442-866f-0595018b2148 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Getting quotas for user 6592aab6435242dca77b854a74ced4f2 and project 798b460fbb2e4be69df7f5f419844832. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:21:40.485275 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8c3ba17a-1405-4442-866f-0595018b2148 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.432876 Jun 07 14:21:40.486565 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 16/43] 10.222.0.81 () {60 vars in 1158 bytes} [Tue Jun 7 14:21:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:21:40.828830 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3b864aa8-66e0-429c-9366-59c66c85c979 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:40.829860 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3b864aa8-66e0-429c-9366-59c66c85c979 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:40.846232 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3b864aa8-66e0-429c-9366-59c66c85c979 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:40.848025 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3b864aa8-66e0-429c-9366-59c66c85c979 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:40.849305 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3b864aa8-66e0-429c-9366-59c66c85c979 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:40.849916 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3b864aa8-66e0-429c-9366-59c66c85c979 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:40.937726 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-706ca4f5-f1d9-43e5-8bd9-9cca63e3dd56 req-b6f3ea4a-7f10-4bec-9ac4-f496fda36a4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09792bed-de41-489d-8ab2-6a1bc9ac884c", "tag": "1652612a-9961-4ecf-8744-a03edaa82b75"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:21:40.972735 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-706ca4f5-f1d9-43e5-8bd9-9cca63e3dd56 req-b6f3ea4a-7f10-4bec-9ac4-f496fda36a4c service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:40.977283 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-706ca4f5-f1d9-43e5-8bd9-9cca63e3dd56 req-b6f3ea4a-7f10-4bec-9ac4-f496fda36a4c service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:40.992275 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3b864aa8-66e0-429c-9366-59c66c85c979 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:41.001556 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3b864aa8-66e0-429c-9366-59c66c85c979 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1216 microversion: 2.1 time: 0.182694 Jun 07 14:21:41.003889 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 17/44] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:40 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1216 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:21:41.009474 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-98edcffd-c4f2-4a40-8f70-22c3d2fc2495 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:41.010111 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-98edcffd-c4f2-4a40-8f70-22c3d2fc2495 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:41.018821 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-98edcffd-c4f2-4a40-8f70-22c3d2fc2495 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:41.019589 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-98edcffd-c4f2-4a40-8f70-22c3d2fc2495 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:41.020736 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-98edcffd-c4f2-4a40-8f70-22c3d2fc2495 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:41.021329 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-98edcffd-c4f2-4a40-8f70-22c3d2fc2495 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:41.043234 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-706ca4f5-f1d9-43e5-8bd9-9cca63e3dd56 req-b6f3ea4a-7f10-4bec-9ac4-f496fda36a4c service nova] Creating event network-changed:1652612a-9961-4ecf-8744-a03edaa82b75 for instance 09792bed-de41-489d-8ab2-6a1bc9ac884c on hv-cinder-83608 Jun 07 14:21:41.051663 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-706ca4f5-f1d9-43e5-8bd9-9cca63e3dd56 req-b6f3ea4a-7f10-4bec-9ac4-f496fda36a4c service nova] Acquired lock "compute-rpcapi-router" {{(pid=117565) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 07 14:21:41.052955 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d3dce98e-7807-4cf5-91b4-4be0607336b2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:41.053620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d3dce98e-7807-4cf5-91b4-4be0607336b2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:41.054691 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d3dce98e-7807-4cf5-91b4-4be0607336b2 None None] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:41.055348 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d3dce98e-7807-4cf5-91b4-4be0607336b2 None None] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:41.073398 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.compute.rpcapi [None req-d3dce98e-7807-4cf5-91b4-4be0607336b2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 07 14:21:41.077834 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d3dce98e-7807-4cf5-91b4-4be0607336b2 None None] Releasing lock "compute-rpcapi-router" {{(pid=117565) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 07 14:21:41.133446 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-d3dce98e-7807-4cf5-91b4-4be0607336b2 None None] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.758461 Jun 07 14:21:41.134388 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 28/45] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:21:41.229801 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-98edcffd-c4f2-4a40-8f70-22c3d2fc2495 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:41.240501 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-98edcffd-c4f2-4a40-8f70-22c3d2fc2495 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 0.235198 Jun 07 14:21:41.245315 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 18/46] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:41 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:42.022349 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-72f59fc5-0541-4722-bbfa-a6c3f2bd5c58 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:42.023823 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-72f59fc5-0541-4722-bbfa-a6c3f2bd5c58 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:42.031494 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-72f59fc5-0541-4722-bbfa-a6c3f2bd5c58 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:42.032345 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-72f59fc5-0541-4722-bbfa-a6c3f2bd5c58 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:42.033345 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-72f59fc5-0541-4722-bbfa-a6c3f2bd5c58 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:42.036808 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-72f59fc5-0541-4722-bbfa-a6c3f2bd5c58 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:42.156888 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-72f59fc5-0541-4722-bbfa-a6c3f2bd5c58 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:42.167071 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-72f59fc5-0541-4722-bbfa-a6c3f2bd5c58 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1216 microversion: 2.1 time: 0.149750 Jun 07 14:21:42.178681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 29/47] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:42 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1216 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:42.268345 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-07392726-6273-448d-a07e-71f8fdd98df4 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:42.271480 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-07392726-6273-448d-a07e-71f8fdd98df4 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:42.280394 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-07392726-6273-448d-a07e-71f8fdd98df4 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:42.281136 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-07392726-6273-448d-a07e-71f8fdd98df4 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:42.282476 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-07392726-6273-448d-a07e-71f8fdd98df4 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:42.283237 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-07392726-6273-448d-a07e-71f8fdd98df4 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:42.643467 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-07392726-6273-448d-a07e-71f8fdd98df4 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:42.654357 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-07392726-6273-448d-a07e-71f8fdd98df4 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 0.398453 Jun 07 14:21:42.656245 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 19/48] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:42 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:43.184377 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b486be0e-84c1-4f43-b002-4de286c2b937 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:43.185005 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b486be0e-84c1-4f43-b002-4de286c2b937 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:43.200626 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b486be0e-84c1-4f43-b002-4de286c2b937 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:43.204301 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b486be0e-84c1-4f43-b002-4de286c2b937 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:43.208245 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b486be0e-84c1-4f43-b002-4de286c2b937 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:43.208938 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b486be0e-84c1-4f43-b002-4de286c2b937 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:43.584154 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-314092a9-4ea4-4d93-8fe8-9c672e2a527f tempest-VolumesGetTestJSON-1653282692 tempest-VolumesGetTestJSON-1653282692-project] Action: 'create', calling method: .version_select at 0x7ff38520c4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-130250042", "metadata": {"Type": "work"}}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:21:43.621312 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b486be0e-84c1-4f43-b002-4de286c2b937 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:43.661508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b486be0e-84c1-4f43-b002-4de286c2b937 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1272 microversion: 2.1 time: 0.480019 Jun 07 14:21:43.689435 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 20/49] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:43 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1272 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:43.709176 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ca51dcb4-c36a-4ef5-b6f8-6babb88dadaa tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:43.712942 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ca51dcb4-c36a-4ef5-b6f8-6babb88dadaa tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:43.728304 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ca51dcb4-c36a-4ef5-b6f8-6babb88dadaa tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:43.730524 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ca51dcb4-c36a-4ef5-b6f8-6babb88dadaa tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:43.735012 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ca51dcb4-c36a-4ef5-b6f8-6babb88dadaa tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:43.737405 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ca51dcb4-c36a-4ef5-b6f8-6babb88dadaa tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:44.577644 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=6 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:44.808803 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ca51dcb4-c36a-4ef5-b6f8-6babb88dadaa tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:44.829240 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ca51dcb4-c36a-4ef5-b6f8-6babb88dadaa tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 1.136661 Jun 07 14:21:44.831295 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 21/50] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:43 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:44.851948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-fd4379ce-4a3b-4b17-816a-45f85af65bde tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:44.852660 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-fd4379ce-4a3b-4b17-816a-45f85af65bde tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:44.877368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fd4379ce-4a3b-4b17-816a-45f85af65bde tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:44.879193 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fd4379ce-4a3b-4b17-816a-45f85af65bde tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:44.883032 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fd4379ce-4a3b-4b17-816a-45f85af65bde tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:44.883733 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fd4379ce-4a3b-4b17-816a-45f85af65bde tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:45.093735 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-fd4379ce-4a3b-4b17-816a-45f85af65bde tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:45.115603 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-fd4379ce-4a3b-4b17-816a-45f85af65bde tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1278 microversion: 2.1 time: 0.271680 Jun 07 14:21:45.118559 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 22/51] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:44 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1278 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:45.462580 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-314092a9-4ea4-4d93-8fe8-9c672e2a527f tempest-VolumesGetTestJSON-1653282692 tempest-VolumesGetTestJSON-1653282692-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.895268 Jun 07 14:21:45.463804 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 30/52] 10.222.0.81 () {60 vars in 1155 bytes} [Tue Jun 7 14:21:42 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2897 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 07 14:21:45.479120 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c0e5f18e-4f46-4814-a1ed-892cf34e1afe tempest-VolumesGetTestJSON-1653282692 tempest-VolumesGetTestJSON-1653282692-project] Calling method '.version_select at 0x7ff384115670>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:45.493618 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-575c303e-7b22-4656-a4cf-7a988401c4c6 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-49755977", "imageRef": "2864004b-970a-480b-8453-14794f9ccca2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9379a31-560f-4227-b159-63bce9fe1b34"}], "security_groups": [{"name": "tempest-securitygroup--279396217"}], "key_name": "tempest-keypair-639870198", "user_data": "}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:21:45.715433 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c0e5f18e-4f46-4814-a1ed-892cf34e1afe tempest-VolumesGetTestJSON-1653282692 tempest-VolumesGetTestJSON-1653282692-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/454568e1-f10d-478f-9b69-a9dc74df75ef" status: 200 len: 353 microversion: 2.1 time: 0.243080 Jun 07 14:21:45.718211 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 23/53] 10.222.0.81 () {58 vars in 1244 bytes} [Tue Jun 7 14:21:45 2022] GET /compute/v2.1/os-volumes/454568e1-f10d-478f-9b69-a9dc74df75ef => generated 353 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:21:45.728325 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-fecc604d-6c6c-4e11-b8a9-2fe340a3060b tempest-VolumesGetTestJSON-1653282692 tempest-VolumesGetTestJSON-1653282692-project] Calling method '.version_select at 0x7ff384126e50>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:45.966558 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-fecc604d-6c6c-4e11-b8a9-2fe340a3060b tempest-VolumesGetTestJSON-1653282692 tempest-VolumesGetTestJSON-1653282692-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/454568e1-f10d-478f-9b69-a9dc74df75ef" status: 200 len: 353 microversion: 2.1 time: 0.242773 Jun 07 14:21:45.982134 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 24/54] 10.222.0.81 () {58 vars in 1244 bytes} [Tue Jun 7 14:21:45 2022] GET /compute/v2.1/os-volumes/454568e1-f10d-478f-9b69-a9dc74df75ef => generated 353 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:21:45.999579 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8aef4fdd-3a36-49fe-9f43-11673e2a8e5b tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:46.006581 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8aef4fdd-3a36-49fe-9f43-11673e2a8e5b tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:46.031560 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8aef4fdd-3a36-49fe-9f43-11673e2a8e5b tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:46.032145 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8aef4fdd-3a36-49fe-9f43-11673e2a8e5b tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:46.033118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8aef4fdd-3a36-49fe-9f43-11673e2a8e5b tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:46.039652 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8aef4fdd-3a36-49fe-9f43-11673e2a8e5b tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:46.193224 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.network.neutron [None req-575c303e-7b22-4656-a4cf-7a988401c4c6 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] validate_networks() for [('c9379a31-560f-4227-b159-63bce9fe1b34', None, None, None, None, None)] {{(pid=117565) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:21:46.983567 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8aef4fdd-3a36-49fe-9f43-11673e2a8e5b tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:47.002647 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8aef4fdd-3a36-49fe-9f43-11673e2a8e5b tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 1.016222 Jun 07 14:21:47.006701 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 25/55] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:45 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:47.019539 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-12d9c2f5-c5cb-4967-be92-5ab492529b90 tempest-VolumesGetTestJSON-1653282692 tempest-VolumesGetTestJSON-1653282692-project] Calling method '.version_select at 0x7ff384115700>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:47.193537 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-12d9c2f5-c5cb-4967-be92-5ab492529b90 tempest-VolumesGetTestJSON-1653282692 tempest-VolumesGetTestJSON-1653282692-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/454568e1-f10d-478f-9b69-a9dc74df75ef" status: 202 len: 0 microversion: 2.1 time: 0.185328 Jun 07 14:21:47.194346 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 26/56] 10.222.0.81 () {58 vars in 1247 bytes} [Tue Jun 7 14:21:47 2022] DELETE /compute/v2.1/os-volumes/454568e1-f10d-478f-9b69-a9dc74df75ef => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:21:47.203609 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f2807251-319f-4467-81cc-7af88bb6fd63 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:47.204652 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f2807251-319f-4467-81cc-7af88bb6fd63 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:47.220980 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f2807251-319f-4467-81cc-7af88bb6fd63 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:47.221786 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f2807251-319f-4467-81cc-7af88bb6fd63 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:47.222880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f2807251-319f-4467-81cc-7af88bb6fd63 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:47.223618 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f2807251-319f-4467-81cc-7af88bb6fd63 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:47.609921 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f2807251-319f-4467-81cc-7af88bb6fd63 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:47.612167 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=4 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:47.623001 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f2807251-319f-4467-81cc-7af88bb6fd63 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1320 microversion: 2.1 time: 0.427330 Jun 07 14:21:47.623950 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 27/57] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:47 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1320 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:47.630508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-af13d542-2687-4fa5-80e6-5852369bfaa4 tempest-VolumesGetTestJSON-1653282692 tempest-VolumesGetTestJSON-1653282692-project] Calling method '.version_select at 0x7ff3840e0550>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:47.711678 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-af13d542-2687-4fa5-80e6-5852369bfaa4 tempest-VolumesGetTestJSON-1653282692 tempest-VolumesGetTestJSON-1653282692-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/454568e1-f10d-478f-9b69-a9dc74df75ef" status: 200 len: 352 microversion: 2.1 time: 0.085782 Jun 07 14:21:47.712269 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 28/58] 10.222.0.81 () {58 vars in 1244 bytes} [Tue Jun 7 14:21:47 2022] GET /compute/v2.1/os-volumes/454568e1-f10d-478f-9b69-a9dc74df75ef => generated 352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:21:47.752848 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-575c303e-7b22-4656-a4cf-7a988401c4c6 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Flavor limits 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:21:47.753355 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-575c303e-7b22-4656-a4cf-7a988401c4c6 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Image limits 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:21:47.753812 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-575c303e-7b22-4656-a4cf-7a988401c4c6 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Flavor pref 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:21:47.754233 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-575c303e-7b22-4656-a4cf-7a988401c4c6 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Image pref 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:21:47.754820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-575c303e-7b22-4656-a4cf-7a988401c4c6 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:21:47.770063 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-575c303e-7b22-4656-a4cf-7a988401c4c6 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:47.770434 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-575c303e-7b22-4656-a4cf-7a988401c4c6 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:47.771276 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-575c303e-7b22-4656-a4cf-7a988401c4c6 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:47.771722 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-575c303e-7b22-4656-a4cf-7a988401c4c6 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:47.800965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-575c303e-7b22-4656-a4cf-7a988401c4c6 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Getting quotas for project 798b460fbb2e4be69df7f5f419844832. Resources: {'ram', 'cores', 'instances'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:21:47.808231 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-575c303e-7b22-4656-a4cf-7a988401c4c6 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Getting quotas for user 6592aab6435242dca77b854a74ced4f2 and project 798b460fbb2e4be69df7f5f419844832. Resources: {'ram', 'cores', 'instances'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:21:47.820236 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-575c303e-7b22-4656-a4cf-7a988401c4c6 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Going to run 1 instances... {{(pid=117565) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:21:47.823028 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-575c303e-7b22-4656-a4cf-7a988401c4c6 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2864004b-970a-480b-8453-14794f9ccca2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:21:47.887477 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-575c303e-7b22-4656-a4cf-7a988401c4c6 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.401774 Jun 07 14:21:47.888144 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 31/59] 10.222.0.81 () {60 vars in 1146 bytes} [Tue Jun 7 14:21:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 2404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:21:47.900179 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3d809a63-401f-4afc-aaf4-ad20f189afda tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:47.900897 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3d809a63-401f-4afc-aaf4-ad20f189afda tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:47.980341 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3d809a63-401f-4afc-aaf4-ad20f189afda tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:47.989569 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3d809a63-401f-4afc-aaf4-ad20f189afda tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1235 microversion: 2.1 time: 0.093945 Jun 07 14:21:47.991936 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 29/60] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:47 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1235 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:48.021998 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-85a805d5-2e1f-444e-ad5c-6f9c24f69284 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:48.022798 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-85a805d5-2e1f-444e-ad5c-6f9c24f69284 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:48.030816 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-85a805d5-2e1f-444e-ad5c-6f9c24f69284 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:48.031489 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-85a805d5-2e1f-444e-ad5c-6f9c24f69284 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:48.032416 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-85a805d5-2e1f-444e-ad5c-6f9c24f69284 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:48.032996 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-85a805d5-2e1f-444e-ad5c-6f9c24f69284 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:48.220378 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-85a805d5-2e1f-444e-ad5c-6f9c24f69284 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:48.223543 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=65 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:48.231825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-85a805d5-2e1f-444e-ad5c-6f9c24f69284 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 0.213941 Jun 07 14:21:48.232400 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 32/61] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:48 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:48.642905 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3c403ba2-c82b-47b2-9753-a5fc0725c8b2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:48.644407 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3c403ba2-c82b-47b2-9753-a5fc0725c8b2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:48.646539 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=10 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:48.655358 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3c403ba2-c82b-47b2-9753-a5fc0725c8b2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:48.656482 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3c403ba2-c82b-47b2-9753-a5fc0725c8b2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:48.657354 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3c403ba2-c82b-47b2-9753-a5fc0725c8b2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:48.657799 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3c403ba2-c82b-47b2-9753-a5fc0725c8b2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:48.728550 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-6c8a666d-fef5-47c9-b58b-a1a24ca36b50 tempest-VolumesGetTestJSON-1653282692 tempest-VolumesGetTestJSON-1653282692-project] Calling method '.version_select at 0x7ff3840dd700>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:48.791015 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-6c8a666d-fef5-47c9-b58b-a1a24ca36b50 tempest-VolumesGetTestJSON-1653282692 tempest-VolumesGetTestJSON-1653282692-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/454568e1-f10d-478f-9b69-a9dc74df75ef" status: 200 len: 352 microversion: 2.1 time: 0.070580 Jun 07 14:21:48.792683 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 33/62] 10.222.0.81 () {58 vars in 1244 bytes} [Tue Jun 7 14:21:48 2022] GET /compute/v2.1/os-volumes/454568e1-f10d-478f-9b69-a9dc74df75ef => generated 352 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:21:48.807709 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3c403ba2-c82b-47b2-9753-a5fc0725c8b2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:48.818350 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3c403ba2-c82b-47b2-9753-a5fc0725c8b2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1320 microversion: 2.1 time: 0.182107 Jun 07 14:21:48.818918 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 30/63] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:48 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1320 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:49.018162 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-436e7e18-d246-4edc-86e2-4d4503c46285 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:49.047553 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-436e7e18-d246-4edc-86e2-4d4503c46285 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:49.053651 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:49.088104 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-436e7e18-d246-4edc-86e2-4d4503c46285 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:49.088758 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-436e7e18-d246-4edc-86e2-4d4503c46285 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:49.089835 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-436e7e18-d246-4edc-86e2-4d4503c46285 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:49.090527 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-436e7e18-d246-4edc-86e2-4d4503c46285 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:49.177443 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-436e7e18-d246-4edc-86e2-4d4503c46285 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:49.187582 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-436e7e18-d246-4edc-86e2-4d4503c46285 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1239 microversion: 2.1 time: 0.179649 Jun 07 14:21:49.197833 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 34/64] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:49 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1239 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:49.251558 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-01e0967b-7b92-48ef-a6ae-ce6900dfa82a tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:49.252924 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-01e0967b-7b92-48ef-a6ae-ce6900dfa82a tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:49.260028 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-01e0967b-7b92-48ef-a6ae-ce6900dfa82a tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:49.260887 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-01e0967b-7b92-48ef-a6ae-ce6900dfa82a tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:49.262017 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-01e0967b-7b92-48ef-a6ae-ce6900dfa82a tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:49.262693 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-01e0967b-7b92-48ef-a6ae-ce6900dfa82a tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:49.490230 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-01e0967b-7b92-48ef-a6ae-ce6900dfa82a tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:49.498982 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-01e0967b-7b92-48ef-a6ae-ce6900dfa82a tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 0.253087 Jun 07 14:21:49.499760 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 31/65] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:49 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:49.807880 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-0fc11122-6321-429d-b79b-5be1403e246a tempest-VolumesGetTestJSON-1653282692 tempest-VolumesGetTestJSON-1653282692-project] Calling method '.version_select at 0x7ff384140d30>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:49.839558 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e4b3820b-399d-452c-aa95-afd2f7e38e05 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:49.840109 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e4b3820b-399d-452c-aa95-afd2f7e38e05 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:49.865128 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e4b3820b-399d-452c-aa95-afd2f7e38e05 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:49.865593 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e4b3820b-399d-452c-aa95-afd2f7e38e05 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:49.866383 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e4b3820b-399d-452c-aa95-afd2f7e38e05 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:49.866835 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e4b3820b-399d-452c-aa95-afd2f7e38e05 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:49.882177 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-0fc11122-6321-429d-b79b-5be1403e246a tempest-VolumesGetTestJSON-1653282692 tempest-VolumesGetTestJSON-1653282692-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/454568e1-f10d-478f-9b69-a9dc74df75ef" status: 200 len: 352 microversion: 2.1 time: 0.078429 Jun 07 14:21:49.882936 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 35/66] 10.222.0.81 () {58 vars in 1244 bytes} [Tue Jun 7 14:21:49 2022] GET /compute/v2.1/os-volumes/454568e1-f10d-478f-9b69-a9dc74df75ef => generated 352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:21:50.142051 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e4b3820b-399d-452c-aa95-afd2f7e38e05 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:50.173837 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e4b3820b-399d-452c-aa95-afd2f7e38e05 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1320 microversion: 2.1 time: 0.341351 Jun 07 14:21:50.182683 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 32/67] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:49 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1320 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:50.217320 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-1270342e-ca4d-4faf-9db7-2c75acbeecc5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:50.218819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-1270342e-ca4d-4faf-9db7-2c75acbeecc5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:50.260819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1270342e-ca4d-4faf-9db7-2c75acbeecc5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:50.261288 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1270342e-ca4d-4faf-9db7-2c75acbeecc5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:50.269310 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1270342e-ca4d-4faf-9db7-2c75acbeecc5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:50.269785 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1270342e-ca4d-4faf-9db7-2c75acbeecc5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:50.439260 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-1270342e-ca4d-4faf-9db7-2c75acbeecc5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:50.451860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-1270342e-ca4d-4faf-9db7-2c75acbeecc5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1239 microversion: 2.1 time: 0.239420 Jun 07 14:21:50.456573 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 36/68] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:50 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1239 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:50.521165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3cee4548-7205-44a7-8ddc-fd673aa40517 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:50.522655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3cee4548-7205-44a7-8ddc-fd673aa40517 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:50.535786 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3cee4548-7205-44a7-8ddc-fd673aa40517 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:50.537358 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3cee4548-7205-44a7-8ddc-fd673aa40517 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:50.538160 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3cee4548-7205-44a7-8ddc-fd673aa40517 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:50.538598 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3cee4548-7205-44a7-8ddc-fd673aa40517 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:50.897924 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d9671542-5cad-418f-8841-5fec8d52fd45 tempest-VolumesGetTestJSON-1653282692 tempest-VolumesGetTestJSON-1653282692-project] Calling method '.version_select at 0x7ff3840ef0d0>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:50.949432 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3cee4548-7205-44a7-8ddc-fd673aa40517 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:50.961230 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3cee4548-7205-44a7-8ddc-fd673aa40517 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 0.446374 Jun 07 14:21:50.973051 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 33/69] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:50 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:50.974538 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-d9671542-5cad-418f-8841-5fec8d52fd45 tempest-VolumesGetTestJSON-1653282692 tempest-VolumesGetTestJSON-1653282692-project] HTTP exception thrown: Volume 454568e1-f10d-478f-9b69-a9dc74df75ef could not be found. Jun 07 14:21:50.977187 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d9671542-5cad-418f-8841-5fec8d52fd45 tempest-VolumesGetTestJSON-1653282692 tempest-VolumesGetTestJSON-1653282692-project] Request method failure captured: Jun 07 14:21:50.977187 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/os-volumes/454568e1-f10d-478f-9b69-a9dc74df75ef HTTP/1.1 Jun 07 14:21:50.977187 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:21:50.977187 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:21:50.977187 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:21:50.977187 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:21:50.977187 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:21:50.977187 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:21:50.977187 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:21:50.977187 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:21:50.977187 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin172hZ-anEfQmG8n1kYi1vDDsNEExVdurMSWGWBaKHUA6AT588a5PwMTyb8VzjRlv_GHP0Xa5h5Hd0CO5guydK0COb7XkSCo66TaVtfjOQWeAzh-3ISb0WqBqkz2-axOadmSDXgA_Mmv1qGFl3cosSYTz3JV7eUfg-bz19dSTKfnYrI Jun 07 14:21:50.977187 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:21:50.977187 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:21:50.977187 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:21:50.977187 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:21:50.977187 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:21:50.977187 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:21:50.977187 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: 1d7ba0d0d1e24ec488a585d52dc77a3c Jun 07 14:21:50.977187 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-VolumesGetTestJSON-1653282692 Jun 07 14:21:50.977187 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:21:50.977187 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:21:50.978325 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1d7ba0d0d1e24ec488a585d52dc77a3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1d7ba0d0d1e24ec488a585d52dc77a3c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1d7ba0d0d1e24ec488a585d52dc77a3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1d7ba0d0d1e24ec488a585d52dc77a3c"}]}] Jun 07 14:21:50.978325 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-VolumesGetTestJSON-1653282692 Jun 07 14:21:50.978325 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: 1d7ba0d0d1e24ec488a585d52dc77a3c Jun 07 14:21:50.978325 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-VolumesGetTestJSON-1653282692 Jun 07 14:21:50.978325 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-VolumesGetTestJSON-1653282692-project Jun 07 14:21:50.978325 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:21:50.978325 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:21:50.978325 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: f414b8819c2f429e9958bd989ba68123 Jun 07 14:21:50.978325 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-VolumesGetTestJSON-1653282692-project Jun 07 14:21:50.978325 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: Jun 07 14:21:50.978325 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Volume 454568e1-f10d-478f-9b69-a9dc74df75ef could not be found. Jun 07 14:21:50.978325 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': '454568e1-f10d-478f-9b69-a9dc74df75ef'} Jun 07 14:21:50.978325 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:21:50.979025 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:50.979025 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:21:50.979025 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:21:50.979025 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 14:21:50.979025 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 14:21:50.979025 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 14:21:50.979025 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 14:21:50.979025 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 14:21:50.979025 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 14:21:50.979025 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 14:21:50.979025 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 14:21:50.979025 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:21:50.979025 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:21:50.979025 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:21:50.979025 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:21:50.979025 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 454568e1-f10d-478f-9b69-a9dc74df75ef could not be found. (HTTP 404) (Request-ID: req-c2bc81f1-fe76-40bc-8709-2f26c7725c48) Jun 07 14:21:50.979025 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:50.979025 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:50.979025 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:50.981146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:50.981146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 14:21:50.981146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 14:21:50.981146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 14:21:50.981146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 14:21:50.981146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 14:21:50.981146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 14:21:50.981146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 14:21:50.981146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 14:21:50.981146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:21:50.981146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:21:50.981146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 14:21:50.981146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 14:21:50.981146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 14:21:50.981146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 14:21:50.981146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 14:21:50.981146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 14:21:50.981146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 14:21:50.981146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 14:21:50.985328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:21:50.985328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:21:50.985328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:21:50.985328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:21:50.985328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 454568e1-f10d-478f-9b69-a9dc74df75ef could not be found. Jun 07 14:21:50.985328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:50.985328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:50.985328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:50.985328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:50.985328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:21:50.985328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:21:50.985328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:21:50.985328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:21:50.985328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 14:21:50.985328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 14:21:50.985328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:21:50.985328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:21:50.985328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 14:21:50.985328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:21:50.989414 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 454568e1-f10d-478f-9b69-a9dc74df75ef could not be found. Jun 07 14:21:50.989414 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:50.989414 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:21:50.989414 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:50.989414 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:21:50.989414 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:21:50.989414 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:21:50.989414 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:21:50.989414 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:21:50.989414 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 454568e1-f10d-478f-9b69-a9dc74df75ef could not be found. Jun 07 14:21:50.989414 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:21:50.989414 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d9671542-5cad-418f-8841-5fec8d52fd45 tempest-VolumesGetTestJSON-1653282692 tempest-VolumesGetTestJSON-1653282692-project] Returning 404 to user: Volume 454568e1-f10d-478f-9b69-a9dc74df75ef could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:21:50.989414 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-d9671542-5cad-418f-8841-5fec8d52fd45 tempest-VolumesGetTestJSON-1653282692 tempest-VolumesGetTestJSON-1653282692-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/454568e1-f10d-478f-9b69-a9dc74df75ef" status: 404 len: 109 microversion: 2.1 time: 0.087527 Jun 07 14:21:50.989414 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 37/70] 10.222.0.81 () {58 vars in 1244 bytes} [Tue Jun 7 14:21:50 2022] GET /compute/v2.1/os-volumes/454568e1-f10d-478f-9b69-a9dc74df75ef => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 14:21:51.199103 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c6b1ad7b-3350-41df-9ee5-b461689b5494 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:51.200496 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c6b1ad7b-3350-41df-9ee5-b461689b5494 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:51.215580 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c6b1ad7b-3350-41df-9ee5-b461689b5494 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:51.216265 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c6b1ad7b-3350-41df-9ee5-b461689b5494 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:51.218102 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c6b1ad7b-3350-41df-9ee5-b461689b5494 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:51.219701 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c6b1ad7b-3350-41df-9ee5-b461689b5494 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:51.471456 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-1c9f90de-7210-403f-98c3-07f49fe55933 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:51.472309 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-1c9f90de-7210-403f-98c3-07f49fe55933 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:51.490662 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1c9f90de-7210-403f-98c3-07f49fe55933 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:51.498291 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1c9f90de-7210-403f-98c3-07f49fe55933 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:51.499598 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1c9f90de-7210-403f-98c3-07f49fe55933 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:51.500476 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1c9f90de-7210-403f-98c3-07f49fe55933 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:51.710735 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c6b1ad7b-3350-41df-9ee5-b461689b5494 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:51.734203 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c6b1ad7b-3350-41df-9ee5-b461689b5494 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1320 microversion: 2.1 time: 0.538596 Jun 07 14:21:51.748670 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 34/71] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:51 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1320 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:51.753625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-1c9f90de-7210-403f-98c3-07f49fe55933 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:51.758861 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-f7371e1d-5d80-4c16-843a-f8436f0c4e02 req-df342607-6355-4b7f-a8dc-1f57f7cb75e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86529cf4-f4ef-45bc-9f34-e0d802dbd846", "tag": "dc669f0a-bd03-4ab4-a4df-85d77316b878"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:21:51.773320 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-1c9f90de-7210-403f-98c3-07f49fe55933 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1231 microversion: 2.1 time: 0.307076 Jun 07 14:21:51.784560 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-f7371e1d-5d80-4c16-843a-f8436f0c4e02 req-df342607-6355-4b7f-a8dc-1f57f7cb75e8 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:51.784560 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-f7371e1d-5d80-4c16-843a-f8436f0c4e02 req-df342607-6355-4b7f-a8dc-1f57f7cb75e8 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:51.789295 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 38/72] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:51 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1231 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:51.834444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-f7371e1d-5d80-4c16-843a-f8436f0c4e02 req-df342607-6355-4b7f-a8dc-1f57f7cb75e8 service nova] Creating event network-changed:dc669f0a-bd03-4ab4-a4df-85d77316b878 for instance 86529cf4-f4ef-45bc-9f34-e0d802dbd846 on hv-cinder-83608 Jun 07 14:21:51.835195 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-f7371e1d-5d80-4c16-843a-f8436f0c4e02 req-df342607-6355-4b7f-a8dc-1f57f7cb75e8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117564) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 07 14:21:51.837043 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7b352220-ab89-45de-9c9c-30cec6ff75e0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:51.841542 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7b352220-ab89-45de-9c9c-30cec6ff75e0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:51.842505 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7b352220-ab89-45de-9c9c-30cec6ff75e0 None None] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:51.842951 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7b352220-ab89-45de-9c9c-30cec6ff75e0 None None] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:51.865769 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.compute.rpcapi [None req-7b352220-ab89-45de-9c9c-30cec6ff75e0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 07 14:21:51.866675 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7b352220-ab89-45de-9c9c-30cec6ff75e0 None None] Releasing lock "compute-rpcapi-router" {{(pid=117564) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 07 14:21:51.903571 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7b352220-ab89-45de-9c9c-30cec6ff75e0 None None] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148840 Jun 07 14:21:51.908366 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 35/73] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:21:51.979945 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-27af6795-4587-4b1e-9c76-defbebc3b690 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:51.980679 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-27af6795-4587-4b1e-9c76-defbebc3b690 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:51.989609 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-27af6795-4587-4b1e-9c76-defbebc3b690 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:51.990061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-27af6795-4587-4b1e-9c76-defbebc3b690 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:51.991487 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-27af6795-4587-4b1e-9c76-defbebc3b690 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:51.991931 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-27af6795-4587-4b1e-9c76-defbebc3b690 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:52.271056 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-27af6795-4587-4b1e-9c76-defbebc3b690 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:52.281431 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-27af6795-4587-4b1e-9c76-defbebc3b690 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 0.306939 Jun 07 14:21:52.293952 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 39/74] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:51 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:52.460374 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-051c575f-4ea1-48aa-b1cb-bef789c5eb07 req-e12be12f-c851-4a7e-afe1-69d2b326e237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dd5700e-2891-4b99-ba1f-d5304a5c8f58", "tag": "7d9b7314-f274-43d0-925f-d9b6683e8642"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:21:52.474261 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-051c575f-4ea1-48aa-b1cb-bef789c5eb07 req-e12be12f-c851-4a7e-afe1-69d2b326e237 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:52.474701 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-051c575f-4ea1-48aa-b1cb-bef789c5eb07 req-e12be12f-c851-4a7e-afe1-69d2b326e237 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:52.500408 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-051c575f-4ea1-48aa-b1cb-bef789c5eb07 req-e12be12f-c851-4a7e-afe1-69d2b326e237 service nova] Creating event network-changed:7d9b7314-f274-43d0-925f-d9b6683e8642 for instance 4dd5700e-2891-4b99-ba1f-d5304a5c8f58 on hv-cinder-83608 Jun 07 14:21:52.508663 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-051c575f-4ea1-48aa-b1cb-bef789c5eb07 req-e12be12f-c851-4a7e-afe1-69d2b326e237 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201062 Jun 07 14:21:52.509555 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 36/75] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:21:52.754197 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-eeec3a23-08fc-47d3-96ed-ad910dc621a5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:52.754886 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-eeec3a23-08fc-47d3-96ed-ad910dc621a5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:52.761654 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-eeec3a23-08fc-47d3-96ed-ad910dc621a5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:52.762287 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-eeec3a23-08fc-47d3-96ed-ad910dc621a5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:52.763097 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-eeec3a23-08fc-47d3-96ed-ad910dc621a5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:52.763660 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-eeec3a23-08fc-47d3-96ed-ad910dc621a5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:52.798932 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2e1a400b-c474-40d3-a30a-d6ceed7ca183 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:52.800882 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2e1a400b-c474-40d3-a30a-d6ceed7ca183 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:52.812345 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2e1a400b-c474-40d3-a30a-d6ceed7ca183 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:52.812604 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2e1a400b-c474-40d3-a30a-d6ceed7ca183 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:52.813550 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2e1a400b-c474-40d3-a30a-d6ceed7ca183 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:52.814103 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2e1a400b-c474-40d3-a30a-d6ceed7ca183 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:53.055397 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2e1a400b-c474-40d3-a30a-d6ceed7ca183 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:53.059006 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=100 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:53.065201 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2e1a400b-c474-40d3-a30a-d6ceed7ca183 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1287 microversion: 2.1 time: 0.272962 Jun 07 14:21:53.075327 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 37/76] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:52 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1287 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:53.116683 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-eeec3a23-08fc-47d3-96ed-ad910dc621a5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:53.124916 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-eeec3a23-08fc-47d3-96ed-ad910dc621a5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1320 microversion: 2.1 time: 0.375788 Jun 07 14:21:53.125468 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 40/77] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:52 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1320 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:53.301956 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0eab6ea6-72b5-4a6c-9be0-8e5afbf29584 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:53.302665 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0eab6ea6-72b5-4a6c-9be0-8e5afbf29584 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:53.308606 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0eab6ea6-72b5-4a6c-9be0-8e5afbf29584 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:53.309056 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0eab6ea6-72b5-4a6c-9be0-8e5afbf29584 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:53.309889 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0eab6ea6-72b5-4a6c-9be0-8e5afbf29584 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:53.310424 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0eab6ea6-72b5-4a6c-9be0-8e5afbf29584 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:53.451772 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0eab6ea6-72b5-4a6c-9be0-8e5afbf29584 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:53.459127 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0eab6ea6-72b5-4a6c-9be0-8e5afbf29584 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 0.161196 Jun 07 14:21:53.459735 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 38/78] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:53 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:54.082413 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-e42efa64-bb2e-46e0-82f3-0c33f7ed45ea tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:54.083021 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-e42efa64-bb2e-46e0-82f3-0c33f7ed45ea tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:54.088961 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e42efa64-bb2e-46e0-82f3-0c33f7ed45ea tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:54.089402 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e42efa64-bb2e-46e0-82f3-0c33f7ed45ea tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:54.090148 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e42efa64-bb2e-46e0-82f3-0c33f7ed45ea tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:54.090603 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e42efa64-bb2e-46e0-82f3-0c33f7ed45ea tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:54.142397 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9bab6c82-38d2-4fb5-be8d-8de4c88ca4d0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:54.142902 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9bab6c82-38d2-4fb5-be8d-8de4c88ca4d0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:54.148955 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9bab6c82-38d2-4fb5-be8d-8de4c88ca4d0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:54.149398 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9bab6c82-38d2-4fb5-be8d-8de4c88ca4d0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:54.150148 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9bab6c82-38d2-4fb5-be8d-8de4c88ca4d0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:54.150576 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9bab6c82-38d2-4fb5-be8d-8de4c88ca4d0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:54.152196 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-e42efa64-bb2e-46e0-82f3-0c33f7ed45ea tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:54.160225 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-e42efa64-bb2e-46e0-82f3-0c33f7ed45ea tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1287 microversion: 2.1 time: 0.081581 Jun 07 14:21:54.160816 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 41/79] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:54 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:54.279949 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9bab6c82-38d2-4fb5-be8d-8de4c88ca4d0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:54.287674 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9bab6c82-38d2-4fb5-be8d-8de4c88ca4d0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1320 microversion: 2.1 time: 0.150090 Jun 07 14:21:54.288239 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 39/80] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:54 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1320 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:21:54.476577 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-caba22a1-e865-435a-aa8e-cb01dd6cbc81 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:54.477208 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-caba22a1-e865-435a-aa8e-cb01dd6cbc81 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:54.483351 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-caba22a1-e865-435a-aa8e-cb01dd6cbc81 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:54.483798 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-caba22a1-e865-435a-aa8e-cb01dd6cbc81 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:54.484554 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-caba22a1-e865-435a-aa8e-cb01dd6cbc81 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:54.484988 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-caba22a1-e865-435a-aa8e-cb01dd6cbc81 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:54.615146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-caba22a1-e865-435a-aa8e-cb01dd6cbc81 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:54.622469 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-caba22a1-e865-435a-aa8e-cb01dd6cbc81 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 0.149962 Jun 07 14:21:54.623696 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 42/81] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:54 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:55.177200 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-288c738e-58b1-431d-8e36-647356dec26a tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:55.177815 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-288c738e-58b1-431d-8e36-647356dec26a tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:55.183717 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-288c738e-58b1-431d-8e36-647356dec26a tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:55.184154 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-288c738e-58b1-431d-8e36-647356dec26a tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:55.184901 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-288c738e-58b1-431d-8e36-647356dec26a tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:55.185385 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-288c738e-58b1-431d-8e36-647356dec26a tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:55.246434 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-288c738e-58b1-431d-8e36-647356dec26a tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:55.254102 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-288c738e-58b1-431d-8e36-647356dec26a tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1287 microversion: 2.1 time: 0.080751 Jun 07 14:21:55.254659 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 40/82] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:55 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:55.305324 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-b9bb3520-be4b-498f-a94c-df0329b1df4f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:55.306055 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-b9bb3520-be4b-498f-a94c-df0329b1df4f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:55.314030 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b9bb3520-be4b-498f-a94c-df0329b1df4f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:55.315250 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b9bb3520-be4b-498f-a94c-df0329b1df4f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:55.317340 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b9bb3520-be4b-498f-a94c-df0329b1df4f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:55.318137 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b9bb3520-be4b-498f-a94c-df0329b1df4f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:55.640527 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-56336ee0-4219-49be-b678-4bc317040ff2 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:55.641367 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-56336ee0-4219-49be-b678-4bc317040ff2 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:55.648323 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-56336ee0-4219-49be-b678-4bc317040ff2 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:55.648854 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-56336ee0-4219-49be-b678-4bc317040ff2 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:55.649782 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-56336ee0-4219-49be-b678-4bc317040ff2 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:55.650292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-56336ee0-4219-49be-b678-4bc317040ff2 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:55.888698 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-b9bb3520-be4b-498f-a94c-df0329b1df4f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:55.897229 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-b9bb3520-be4b-498f-a94c-df0329b1df4f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1320 microversion: 2.1 time: 0.595649 Jun 07 14:21:55.897905 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 43/83] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:55 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1320 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:55.927876 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-56336ee0-4219-49be-b678-4bc317040ff2 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:55.935408 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-56336ee0-4219-49be-b678-4bc317040ff2 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 0.299275 Jun 07 14:21:55.936146 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 41/84] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:55 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:56.270824 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-14ee9133-78b6-4b6d-a543-e87c59a895da tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:56.271390 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-14ee9133-78b6-4b6d-a543-e87c59a895da tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:56.277354 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-14ee9133-78b6-4b6d-a543-e87c59a895da tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:56.277795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-14ee9133-78b6-4b6d-a543-e87c59a895da tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:56.278547 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-14ee9133-78b6-4b6d-a543-e87c59a895da tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:56.278980 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-14ee9133-78b6-4b6d-a543-e87c59a895da tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:56.339605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-14ee9133-78b6-4b6d-a543-e87c59a895da tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:56.347435 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-14ee9133-78b6-4b6d-a543-e87c59a895da tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1293 microversion: 2.1 time: 0.080529 Jun 07 14:21:56.347997 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 44/85] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:56 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:56.914043 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f7619ad8-9904-43a2-9b8a-265b93e4ed75 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:56.914654 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f7619ad8-9904-43a2-9b8a-265b93e4ed75 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:56.922447 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f7619ad8-9904-43a2-9b8a-265b93e4ed75 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:56.922898 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f7619ad8-9904-43a2-9b8a-265b93e4ed75 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:56.923676 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f7619ad8-9904-43a2-9b8a-265b93e4ed75 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:56.924110 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f7619ad8-9904-43a2-9b8a-265b93e4ed75 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:56.953386 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d0c4cd1f-98bb-4b03-a28e-5d663bc89e44 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:56.954028 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-d0c4cd1f-98bb-4b03-a28e-5d663bc89e44 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:56.960020 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d0c4cd1f-98bb-4b03-a28e-5d663bc89e44 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:56.960466 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d0c4cd1f-98bb-4b03-a28e-5d663bc89e44 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:56.961402 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d0c4cd1f-98bb-4b03-a28e-5d663bc89e44 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:56.961685 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d0c4cd1f-98bb-4b03-a28e-5d663bc89e44 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:57.110490 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f7619ad8-9904-43a2-9b8a-265b93e4ed75 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:57.118107 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f7619ad8-9904-43a2-9b8a-265b93e4ed75 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1320 microversion: 2.1 time: 0.207854 Jun 07 14:21:57.118759 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 42/86] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:56 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1320 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:57.132805 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-d0c4cd1f-98bb-4b03-a28e-5d663bc89e44 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:57.141123 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-d0c4cd1f-98bb-4b03-a28e-5d663bc89e44 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 0.191516 Jun 07 14:21:57.141668 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 45/87] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:56 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:21:57.364728 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f2e015db-0065-4306-a9e7-bb43d6652ed3 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:57.365259 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f2e015db-0065-4306-a9e7-bb43d6652ed3 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:57.371359 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f2e015db-0065-4306-a9e7-bb43d6652ed3 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:57.371800 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f2e015db-0065-4306-a9e7-bb43d6652ed3 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:57.372552 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f2e015db-0065-4306-a9e7-bb43d6652ed3 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:57.372983 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f2e015db-0065-4306-a9e7-bb43d6652ed3 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:57.434666 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f2e015db-0065-4306-a9e7-bb43d6652ed3 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:57.442854 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f2e015db-0065-4306-a9e7-bb43d6652ed3 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1293 microversion: 2.1 time: 0.082123 Jun 07 14:21:57.443526 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 43/88] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:57 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:21:58.136417 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-f2f52032-4e70-4c07-8061-68a4394d4cbd tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:58.137035 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-f2f52032-4e70-4c07-8061-68a4394d4cbd tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:58.138909 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=4 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:58.139582 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=6 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:58.145734 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f2f52032-4e70-4c07-8061-68a4394d4cbd tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:58.146192 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f2f52032-4e70-4c07-8061-68a4394d4cbd tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:58.146959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f2f52032-4e70-4c07-8061-68a4394d4cbd tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:58.147466 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f2f52032-4e70-4c07-8061-68a4394d4cbd tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:58.158299 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a85618e2-bbf6-4099-b256-870b2f49f576 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:58.158933 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a85618e2-bbf6-4099-b256-870b2f49f576 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:58.160835 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=26 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:58.166387 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a85618e2-bbf6-4099-b256-870b2f49f576 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:58.166837 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a85618e2-bbf6-4099-b256-870b2f49f576 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:58.167640 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a85618e2-bbf6-4099-b256-870b2f49f576 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:58.168070 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a85618e2-bbf6-4099-b256-870b2f49f576 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:58.349735 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-f2f52032-4e70-4c07-8061-68a4394d4cbd tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:58.356858 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a85618e2-bbf6-4099-b256-870b2f49f576 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:58.357413 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-f2f52032-4e70-4c07-8061-68a4394d4cbd tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1320 microversion: 2.1 time: 0.226073 Jun 07 14:21:58.358215 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 46/89] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:58 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1320 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:58.365305 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a85618e2-bbf6-4099-b256-870b2f49f576 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 0.210783 Jun 07 14:21:58.365966 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 44/90] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:58 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:58.459832 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-6de2ab89-03f9-4951-a50e-acdc123eac23 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:58.460450 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-6de2ab89-03f9-4951-a50e-acdc123eac23 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:58.466394 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6de2ab89-03f9-4951-a50e-acdc123eac23 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:58.466839 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6de2ab89-03f9-4951-a50e-acdc123eac23 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:58.467724 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6de2ab89-03f9-4951-a50e-acdc123eac23 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:58.468165 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6de2ab89-03f9-4951-a50e-acdc123eac23 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:58.528748 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-6de2ab89-03f9-4951-a50e-acdc123eac23 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:58.536368 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-6de2ab89-03f9-4951-a50e-acdc123eac23 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1293 microversion: 2.1 time: 0.080292 Jun 07 14:21:58.536937 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 47/91] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:58 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:59.374715 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f2007bb4-6167-4d7f-a10d-f836c757f53c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:59.375681 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f2007bb4-6167-4d7f-a10d-f836c757f53c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:59.382998 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-827c9e46-8e3a-42fd-b8a8-b911335c8a80 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:59.383518 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f2007bb4-6167-4d7f-a10d-f836c757f53c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:59.383845 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f2007bb4-6167-4d7f-a10d-f836c757f53c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:59.384445 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-827c9e46-8e3a-42fd-b8a8-b911335c8a80 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:59.384638 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f2007bb4-6167-4d7f-a10d-f836c757f53c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:59.385075 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f2007bb4-6167-4d7f-a10d-f836c757f53c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:59.392167 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-827c9e46-8e3a-42fd-b8a8-b911335c8a80 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:59.392710 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-827c9e46-8e3a-42fd-b8a8-b911335c8a80 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:59.393562 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-827c9e46-8e3a-42fd-b8a8-b911335c8a80 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:59.394098 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-827c9e46-8e3a-42fd-b8a8-b911335c8a80 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:59.679600 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-827c9e46-8e3a-42fd-b8a8-b911335c8a80 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:59.686987 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f2007bb4-6167-4d7f-a10d-f836c757f53c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:59.688232 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-827c9e46-8e3a-42fd-b8a8-b911335c8a80 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 0.309103 Jun 07 14:21:59.702879 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 48/92] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:59 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:59.713591 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-568f6301-421d-4a51-b857-859b6107ad96 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:21:59.713591 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-568f6301-421d-4a51-b857-859b6107ad96 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:21:59.723393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f2007bb4-6167-4d7f-a10d-f836c757f53c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1320 microversion: 2.1 time: 0.352358 Jun 07 14:21:59.725250 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 45/93] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:59 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1320 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:21:59.727707 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-568f6301-421d-4a51-b857-859b6107ad96 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:59.728319 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-568f6301-421d-4a51-b857-859b6107ad96 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:59.729282 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-568f6301-421d-4a51-b857-859b6107ad96 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:21:59.729725 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-568f6301-421d-4a51-b857-859b6107ad96 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:21:59.962400 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-568f6301-421d-4a51-b857-859b6107ad96 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:21:59.970981 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-568f6301-421d-4a51-b857-859b6107ad96 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1360 microversion: 2.1 time: 0.264930 Jun 07 14:21:59.971625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 49/94] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:21:59 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1360 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:00.087541 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b011d066-934b-4830-a821-31d5beb890c3 tempest-VolumesTestJSON-2054560174 tempest-VolumesTestJSON-2054560174-project] Calling method '.version_select at 0x7ff3840f29d0>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:00.139362 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b011d066-934b-4830-a821-31d5beb890c3 tempest-VolumesTestJSON-2054560174 tempest-VolumesTestJSON-2054560174-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/59403412-792a-44ad-a301-a1d33a6772fe" status: 200 len: 349 microversion: 2.1 time: 0.055654 Jun 07 14:22:00.140510 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 46/95] 10.222.0.81 () {58 vars in 1244 bytes} [Tue Jun 7 14:22:00 2022] GET /compute/v2.1/os-volumes/59403412-792a-44ad-a301-a1d33a6772fe => generated 349 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:22:00.705288 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-900ba26c-03e6-4afe-bead-3e815fbb3788 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:00.705893 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-900ba26c-03e6-4afe-bead-3e815fbb3788 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:00.716977 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-900ba26c-03e6-4afe-bead-3e815fbb3788 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:00.718176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-900ba26c-03e6-4afe-bead-3e815fbb3788 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:00.720627 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-900ba26c-03e6-4afe-bead-3e815fbb3788 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:00.724335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-900ba26c-03e6-4afe-bead-3e815fbb3788 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:00.750885 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-984750d8-45ce-4566-96ef-2d9ff5983a96 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:00.762263 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-984750d8-45ce-4566-96ef-2d9ff5983a96 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:00.768823 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-984750d8-45ce-4566-96ef-2d9ff5983a96 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:00.769662 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-984750d8-45ce-4566-96ef-2d9ff5983a96 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:00.770953 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-984750d8-45ce-4566-96ef-2d9ff5983a96 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:00.771840 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-984750d8-45ce-4566-96ef-2d9ff5983a96 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:01.104317 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-900ba26c-03e6-4afe-bead-3e815fbb3788 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:01.110241 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-984750d8-45ce-4566-96ef-2d9ff5983a96 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:01.117427 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-900ba26c-03e6-4afe-bead-3e815fbb3788 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 0.415744 Jun 07 14:22:01.119045 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 50/96] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:00 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:01.131841 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-b9b3a84b-0bc1-44e1-8458-ef40a0802bb4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:01.132867 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-b9b3a84b-0bc1-44e1-8458-ef40a0802bb4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:01.134235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-984750d8-45ce-4566-96ef-2d9ff5983a96 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1320 microversion: 2.1 time: 0.396324 Jun 07 14:22:01.135437 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 47/97] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:00 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1320 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:22:01.177891 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b9b3a84b-0bc1-44e1-8458-ef40a0802bb4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:01.179976 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b9b3a84b-0bc1-44e1-8458-ef40a0802bb4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:01.181060 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b9b3a84b-0bc1-44e1-8458-ef40a0802bb4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:01.181612 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b9b3a84b-0bc1-44e1-8458-ef40a0802bb4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:01.505001 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-b9b3a84b-0bc1-44e1-8458-ef40a0802bb4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:01.513007 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-b9b3a84b-0bc1-44e1-8458-ef40a0802bb4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1360 microversion: 2.1 time: 0.392300 Jun 07 14:22:01.513793 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 51/98] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:01 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1360 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:01.537486 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-bfecf21c-82bd-43da-b999-dcc175e30693 req-8441aab0-b117-4f5d-ac62-fc6a1eb36957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09792bed-de41-489d-8ab2-6a1bc9ac884c", "name": "network-vif-plugged", "status": "completed", "tag": "1652612a-9961-4ecf-8744-a03edaa82b75"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:22:01.547506 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-bfecf21c-82bd-43da-b999-dcc175e30693 req-8441aab0-b117-4f5d-ac62-fc6a1eb36957 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:01.548285 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-bfecf21c-82bd-43da-b999-dcc175e30693 req-8441aab0-b117-4f5d-ac62-fc6a1eb36957 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:01.565118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-bfecf21c-82bd-43da-b999-dcc175e30693 req-8441aab0-b117-4f5d-ac62-fc6a1eb36957 service nova] Creating event network-vif-plugged:1652612a-9961-4ecf-8744-a03edaa82b75 for instance 09792bed-de41-489d-8ab2-6a1bc9ac884c on hv-cinder-83608 Jun 07 14:22:01.572537 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-bfecf21c-82bd-43da-b999-dcc175e30693 req-8441aab0-b117-4f5d-ac62-fc6a1eb36957 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135904 Jun 07 14:22:01.574586 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 48/99] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:22:01.607137 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-46ad045b-3866-465b-97e5-fd7f98653982 req-3dcd1e80-f85f-4bc7-9167-62163a6c9466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b", "tag": "3fcce599-f9f4-4a19-a2d1-e0608cd6435f"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:22:01.615649 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-46ad045b-3866-465b-97e5-fd7f98653982 req-3dcd1e80-f85f-4bc7-9167-62163a6c9466 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:01.616077 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-46ad045b-3866-465b-97e5-fd7f98653982 req-3dcd1e80-f85f-4bc7-9167-62163a6c9466 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:01.629012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-46ad045b-3866-465b-97e5-fd7f98653982 req-3dcd1e80-f85f-4bc7-9167-62163a6c9466 service nova] Creating event network-changed:3fcce599-f9f4-4a19-a2d1-e0608cd6435f for instance ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b on hv-cinder-83608 Jun 07 14:22:01.633859 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-46ad045b-3866-465b-97e5-fd7f98653982 req-3dcd1e80-f85f-4bc7-9167-62163a6c9466 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030989 Jun 07 14:22:01.634998 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 52/100] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:22:01.704502 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1cb626a5-5c1c-4e04-8ae8-a768fc1b084d tempest-VolumesTestJSON-2054560174 tempest-VolumesTestJSON-2054560174-project] Calling method '.version_select at 0x7ff3840f2e50>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:01.760437 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1cb626a5-5c1c-4e04-8ae8-a768fc1b084d tempest-VolumesTestJSON-2054560174 tempest-VolumesTestJSON-2054560174-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/20f0e5d8-2581-4981-98be-8c039584e31f" status: 200 len: 351 microversion: 2.1 time: 0.060050 Jun 07 14:22:01.767537 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 49/101] 10.222.0.81 () {58 vars in 1244 bytes} [Tue Jun 7 14:22:01 2022] GET /compute/v2.1/os-volumes/20f0e5d8-2581-4981-98be-8c039584e31f => generated 351 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:22:02.138582 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7bba1a00-2648-453e-9da8-c7d7063731c5 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:02.140473 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-7bba1a00-2648-453e-9da8-c7d7063731c5 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:02.147886 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:02.153049 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1f495ed4-df48-4061-91fe-f4a187d4cf6e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:02.153851 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1f495ed4-df48-4061-91fe-f4a187d4cf6e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:02.160489 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7bba1a00-2648-453e-9da8-c7d7063731c5 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:02.166062 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1f495ed4-df48-4061-91fe-f4a187d4cf6e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:02.167042 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1f495ed4-df48-4061-91fe-f4a187d4cf6e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:02.167175 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7bba1a00-2648-453e-9da8-c7d7063731c5 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:02.169271 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7bba1a00-2648-453e-9da8-c7d7063731c5 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:02.170119 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1f495ed4-df48-4061-91fe-f4a187d4cf6e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:02.171044 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1f495ed4-df48-4061-91fe-f4a187d4cf6e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:02.171597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7bba1a00-2648-453e-9da8-c7d7063731c5 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:02.216432 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=100 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:02.448364 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-7bba1a00-2648-453e-9da8-c7d7063731c5 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:02.457697 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-7bba1a00-2648-453e-9da8-c7d7063731c5 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 0.324905 Jun 07 14:22:02.458434 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 53/102] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:02 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:02.475743 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1f495ed4-df48-4061-91fe-f4a187d4cf6e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:02.483773 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1f495ed4-df48-4061-91fe-f4a187d4cf6e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1320 microversion: 2.1 time: 0.336111 Jun 07 14:22:02.484534 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 50/103] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:02 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1320 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:22:02.530127 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-72bee0d7-95b3-45c4-be70-8748825e5760 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:02.530725 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-72bee0d7-95b3-45c4-be70-8748825e5760 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:02.537917 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-72bee0d7-95b3-45c4-be70-8748825e5760 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:02.538361 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-72bee0d7-95b3-45c4-be70-8748825e5760 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:02.539735 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-72bee0d7-95b3-45c4-be70-8748825e5760 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:02.540224 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-72bee0d7-95b3-45c4-be70-8748825e5760 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:02.732011 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-72bee0d7-95b3-45c4-be70-8748825e5760 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:02.740641 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-72bee0d7-95b3-45c4-be70-8748825e5760 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1360 microversion: 2.1 time: 0.214691 Jun 07 14:22:02.741224 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 54/104] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:02 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1360 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:03.478348 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-778c07c3-9315-4438-9c25-ff85aac6cd0f tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:03.492258 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-778c07c3-9315-4438-9c25-ff85aac6cd0f tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:03.502237 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-778c07c3-9315-4438-9c25-ff85aac6cd0f tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:03.502651 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-0dee51f4-5aa4-4f2d-b4dd-1e575b48c6d8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:03.503728 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-778c07c3-9315-4438-9c25-ff85aac6cd0f tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:03.503972 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-0dee51f4-5aa4-4f2d-b4dd-1e575b48c6d8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:03.505134 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-778c07c3-9315-4438-9c25-ff85aac6cd0f tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:03.506072 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-778c07c3-9315-4438-9c25-ff85aac6cd0f tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:03.513336 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0dee51f4-5aa4-4f2d-b4dd-1e575b48c6d8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:03.513966 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0dee51f4-5aa4-4f2d-b4dd-1e575b48c6d8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:03.515629 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0dee51f4-5aa4-4f2d-b4dd-1e575b48c6d8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:03.516077 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0dee51f4-5aa4-4f2d-b4dd-1e575b48c6d8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:03.719511 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-778c07c3-9315-4438-9c25-ff85aac6cd0f tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:03.722943 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-0dee51f4-5aa4-4f2d-b4dd-1e575b48c6d8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:03.732090 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-778c07c3-9315-4438-9c25-ff85aac6cd0f tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 0.258811 Jun 07 14:22:03.733680 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 51/105] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:03 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:03.736982 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-0dee51f4-5aa4-4f2d-b4dd-1e575b48c6d8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1320 microversion: 2.1 time: 0.239289 Jun 07 14:22:03.738039 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 55/106] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:03 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1320 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:22:03.758071 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c86674e0-3423-4124-9e5f-9f94bb1940e4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:03.758770 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c86674e0-3423-4124-9e5f-9f94bb1940e4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:03.765144 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c86674e0-3423-4124-9e5f-9f94bb1940e4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:03.765676 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c86674e0-3423-4124-9e5f-9f94bb1940e4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:03.766530 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c86674e0-3423-4124-9e5f-9f94bb1940e4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:03.767053 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c86674e0-3423-4124-9e5f-9f94bb1940e4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:03.913070 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c86674e0-3423-4124-9e5f-9f94bb1940e4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:03.921454 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c86674e0-3423-4124-9e5f-9f94bb1940e4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1360 microversion: 2.1 time: 0.167545 Jun 07 14:22:03.922248 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 52/107] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:03 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1360 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:04.752180 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-858a88ee-2cc2-4696-ac86-ad5545e5864c tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:04.752800 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-858a88ee-2cc2-4696-ac86-ad5545e5864c tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:04.756082 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c28b7d7f-30f3-4807-901e-90ca58658228 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:04.757466 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c28b7d7f-30f3-4807-901e-90ca58658228 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:04.761023 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-858a88ee-2cc2-4696-ac86-ad5545e5864c tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:04.761800 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-858a88ee-2cc2-4696-ac86-ad5545e5864c tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:04.762264 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-858a88ee-2cc2-4696-ac86-ad5545e5864c tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:04.762759 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-858a88ee-2cc2-4696-ac86-ad5545e5864c tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:04.766728 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c28b7d7f-30f3-4807-901e-90ca58658228 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:04.767435 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c28b7d7f-30f3-4807-901e-90ca58658228 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:04.785890 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c28b7d7f-30f3-4807-901e-90ca58658228 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:04.786914 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c28b7d7f-30f3-4807-901e-90ca58658228 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:05.434863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-858a88ee-2cc2-4696-ac86-ad5545e5864c tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:05.447655 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-858a88ee-2cc2-4696-ac86-ad5545e5864c tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 0.701449 Jun 07 14:22:05.468148 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 56/108] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:04 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:05.474721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-61cb3b3b-dad1-4c1f-a88e-ff69899a251f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:05.479826 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-61cb3b3b-dad1-4c1f-a88e-ff69899a251f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:05.492677 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-61cb3b3b-dad1-4c1f-a88e-ff69899a251f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:05.493357 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-61cb3b3b-dad1-4c1f-a88e-ff69899a251f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:05.498226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-61cb3b3b-dad1-4c1f-a88e-ff69899a251f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:05.499438 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-61cb3b3b-dad1-4c1f-a88e-ff69899a251f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:05.504878 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c28b7d7f-30f3-4807-901e-90ca58658228 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:05.512432 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c28b7d7f-30f3-4807-901e-90ca58658228 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1320 microversion: 2.1 time: 0.761999 Jun 07 14:22:05.520711 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 53/109] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:04 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1320 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:05.530541 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8d296300-c96f-4fda-99f9-dd5b45bb6299 tempest-VolumesTestJSON-2054560174 tempest-VolumesTestJSON-2054560174-project] Calling method '.version_select at 0x7ff38417f9d0>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:05.651428 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8d296300-c96f-4fda-99f9-dd5b45bb6299 tempest-VolumesTestJSON-2054560174 tempest-VolumesTestJSON-2054560174-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/ffd6153f-c7a2-4dfb-aa9f-de7319a3cee1" status: 200 len: 350 microversion: 2.1 time: 0.129071 Jun 07 14:22:05.652403 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 54/110] 10.222.0.81 () {58 vars in 1244 bytes} [Tue Jun 7 14:22:05 2022] GET /compute/v2.1/os-volumes/ffd6153f-c7a2-4dfb-aa9f-de7319a3cee1 => generated 350 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:22:05.663190 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-8ef4a35d-06eb-4f9e-bf51-151ac0e85c3d req-15431af4-a882-45b4-870f-af3c14780314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86529cf4-f4ef-45bc-9f34-e0d802dbd846", "name": "network-vif-plugged", "status": "completed", "tag": "dc669f0a-bd03-4ab4-a4df-85d77316b878"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:22:05.681154 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-8ef4a35d-06eb-4f9e-bf51-151ac0e85c3d req-15431af4-a882-45b4-870f-af3c14780314 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:05.681855 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-8ef4a35d-06eb-4f9e-bf51-151ac0e85c3d req-15431af4-a882-45b4-870f-af3c14780314 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:05.708887 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-8ef4a35d-06eb-4f9e-bf51-151ac0e85c3d req-15431af4-a882-45b4-870f-af3c14780314 service nova] Creating event network-vif-plugged:dc669f0a-bd03-4ab4-a4df-85d77316b878 for instance 86529cf4-f4ef-45bc-9f34-e0d802dbd846 on hv-cinder-83608 Jun 07 14:22:05.719042 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-8ef4a35d-06eb-4f9e-bf51-151ac0e85c3d req-15431af4-a882-45b4-870f-af3c14780314 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064955 Jun 07 14:22:05.723794 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 55/111] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:22:05.744716 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e2286fe5-4460-411b-92d0-8e46ce05f7a0 tempest-VolumesTestJSON-2054560174 tempest-VolumesTestJSON-2054560174-project] Calling method '.version_select at 0x7ff384185f70>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:05.904334 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e2286fe5-4460-411b-92d0-8e46ce05f7a0 tempest-VolumesTestJSON-2054560174 tempest-VolumesTestJSON-2054560174-project] 10.222.0.81 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.179187 Jun 07 14:22:05.905628 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 56/112] 10.222.0.81 () {58 vars in 1133 bytes} [Tue Jun 7 14:22:05 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:05.918447 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b6d71fd7-6c0e-4c53-a293-52906a871854 tempest-VolumesTestJSON-2054560174 tempest-VolumesTestJSON-2054560174-project] Calling method '.version_select at 0x7ff3840f2e50>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:06.000550 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-61cb3b3b-dad1-4c1f-a88e-ff69899a251f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:06.009015 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-61cb3b3b-dad1-4c1f-a88e-ff69899a251f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1360 microversion: 2.1 time: 0.539537 Jun 07 14:22:06.009591 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 57/113] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:05 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1360 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:06.148653 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b6d71fd7-6c0e-4c53-a293-52906a871854 tempest-VolumesTestJSON-2054560174 tempest-VolumesTestJSON-2054560174-project] 10.222.0.81 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.233955 Jun 07 14:22:06.149660 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 57/114] 10.222.0.81 () {58 vars in 1148 bytes} [Tue Jun 7 14:22:05 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:22:06.165439 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-6ed5ce7f-957f-48ba-8936-08d58f24cc9f tempest-VolumesTestJSON-2054560174 tempest-VolumesTestJSON-2054560174-project] Calling method '.version_select at 0x7ff3840b9280>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:06.337140 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-6ed5ce7f-957f-48ba-8936-08d58f24cc9f tempest-VolumesTestJSON-2054560174 tempest-VolumesTestJSON-2054560174-project] 10.222.0.81 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.175432 Jun 07 14:22:06.346925 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 58/115] 10.222.0.81 () {58 vars in 1133 bytes} [Tue Jun 7 14:22:06 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:06.351872 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ebe3b946-52ea-4966-97e6-f37138458318 tempest-VolumesTestJSON-2054560174 tempest-VolumesTestJSON-2054560174-project] Calling method '.version_select at 0x7ff38418e550>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:06.446068 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ebe3b946-52ea-4966-97e6-f37138458318 tempest-VolumesTestJSON-2054560174 tempest-VolumesTestJSON-2054560174-project] 10.222.0.81 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.098112 Jun 07 14:22:06.446650 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 58/116] 10.222.0.81 () {58 vars in 1166 bytes} [Tue Jun 7 14:22:06 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:22:06.461092 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-4a3ca9ba-ae0b-45d3-b00b-a5bd9209d556 tempest-VolumesTestJSON-2054560174 tempest-VolumesTestJSON-2054560174-project] Calling method '.version_select at 0x7ff3840dd700>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:06.464115 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-07943678-f3cc-4781-b10a-2d9f75d9a5ea tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:06.464943 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-07943678-f3cc-4781-b10a-2d9f75d9a5ea tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:06.477113 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-07943678-f3cc-4781-b10a-2d9f75d9a5ea tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:06.478039 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-07943678-f3cc-4781-b10a-2d9f75d9a5ea tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:06.479575 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-07943678-f3cc-4781-b10a-2d9f75d9a5ea tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:06.480159 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-07943678-f3cc-4781-b10a-2d9f75d9a5ea tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:06.704462 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-4a3ca9ba-ae0b-45d3-b00b-a5bd9209d556 tempest-VolumesTestJSON-2054560174 tempest-VolumesTestJSON-2054560174-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.248282 Jun 07 14:22:06.705416 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 59/117] 10.222.0.81 () {58 vars in 1169 bytes} [Tue Jun 7 14:22:06 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:22:06.716145 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ebc7fd3a-58c3-42ec-a499-df56d88392fa tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:06.717950 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ebc7fd3a-58c3-42ec-a499-df56d88392fa tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:06.725777 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ebc7fd3a-58c3-42ec-a499-df56d88392fa tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:06.726234 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ebc7fd3a-58c3-42ec-a499-df56d88392fa tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:06.727970 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ebc7fd3a-58c3-42ec-a499-df56d88392fa tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:06.727970 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ebc7fd3a-58c3-42ec-a499-df56d88392fa tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:06.750697 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-07943678-f3cc-4781-b10a-2d9f75d9a5ea tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:06.759555 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-07943678-f3cc-4781-b10a-2d9f75d9a5ea tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 0.299044 Jun 07 14:22:06.767867 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 59/118] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:06 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:06.773479 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6d068781-f4ef-45d6-a69c-a3befe5503b1 tempest-VolumesTestJSON-2054560174 tempest-VolumesTestJSON-2054560174-project] Calling method '.version_select at 0x7ff38524cc10>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:06.862480 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6d068781-f4ef-45d6-a69c-a3befe5503b1 tempest-VolumesTestJSON-2054560174 tempest-VolumesTestJSON-2054560174-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.093343 Jun 07 14:22:06.863274 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 60/119] 10.222.0.81 () {58 vars in 1154 bytes} [Tue Jun 7 14:22:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:06.879633 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-492a28e9-0588-417e-97db-7a183b64c5f1 tempest-VolumesTestJSON-2054560174 tempest-VolumesTestJSON-2054560174-project] Calling method '.version_select at 0x7ff384185f70>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:06.959188 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ebc7fd3a-58c3-42ec-a499-df56d88392fa tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:06.969223 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ebc7fd3a-58c3-42ec-a499-df56d88392fa tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1320 microversion: 2.1 time: 0.262536 Jun 07 14:22:06.979004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 60/120] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:06 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1320 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:06.989826 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-492a28e9-0588-417e-97db-7a183b64c5f1 tempest-VolumesTestJSON-2054560174 tempest-VolumesTestJSON-2054560174-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.119123 Jun 07 14:22:06.990508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 61/121] 10.222.0.81 () {58 vars in 1187 bytes} [Tue Jun 7 14:22:06 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:22:07.004334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-723cc965-062c-483b-96af-7e837948ce35 tempest-VolumesTestJSON-2054560174 tempest-VolumesTestJSON-2054560174-project] Calling method '.version_select at 0x7ff384140ee0>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:07.028151 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9efa0d78-fddb-426d-8ab5-6c72ee11919f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:07.029244 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9efa0d78-fddb-426d-8ab5-6c72ee11919f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:07.038795 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9efa0d78-fddb-426d-8ab5-6c72ee11919f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:07.040109 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9efa0d78-fddb-426d-8ab5-6c72ee11919f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:07.041094 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9efa0d78-fddb-426d-8ab5-6c72ee11919f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:07.041728 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9efa0d78-fddb-426d-8ab5-6c72ee11919f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:07.091786 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-723cc965-062c-483b-96af-7e837948ce35 tempest-VolumesTestJSON-2054560174 tempest-VolumesTestJSON-2054560174-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.092975 Jun 07 14:22:07.092947 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 61/122] 10.222.0.81 () {58 vars in 1154 bytes} [Tue Jun 7 14:22:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:07.209101 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9efa0d78-fddb-426d-8ab5-6c72ee11919f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:07.223136 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9efa0d78-fddb-426d-8ab5-6c72ee11919f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1360 microversion: 2.1 time: 0.200373 Jun 07 14:22:07.224279 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 62/123] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:07 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1360 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:22:07.778014 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3cf08406-100b-4668-9a1f-1d58ec1f3786 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:07.781789 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-3cf08406-100b-4668-9a1f-1d58ec1f3786 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:07.796580 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3cf08406-100b-4668-9a1f-1d58ec1f3786 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:07.798557 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3cf08406-100b-4668-9a1f-1d58ec1f3786 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:07.801820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3cf08406-100b-4668-9a1f-1d58ec1f3786 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:07.803064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3cf08406-100b-4668-9a1f-1d58ec1f3786 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:07.972880 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-3cf08406-100b-4668-9a1f-1d58ec1f3786 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:07.988202 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-06bc6b22-4fe1-4194-91a5-2c07fbc442bc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:07.988813 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-06bc6b22-4fe1-4194-91a5-2c07fbc442bc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:07.994125 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-3cf08406-100b-4668-9a1f-1d58ec1f3786 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 0.221405 Jun 07 14:22:07.994744 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-06bc6b22-4fe1-4194-91a5-2c07fbc442bc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:07.995363 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 62/124] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:07 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:07.996023 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-06bc6b22-4fe1-4194-91a5-2c07fbc442bc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:07.996800 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-06bc6b22-4fe1-4194-91a5-2c07fbc442bc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:07.997426 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-06bc6b22-4fe1-4194-91a5-2c07fbc442bc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:08.142892 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-06bc6b22-4fe1-4194-91a5-2c07fbc442bc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:08.146389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=100 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:08.151496 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-06bc6b22-4fe1-4194-91a5-2c07fbc442bc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1320 microversion: 2.1 time: 0.168808 Jun 07 14:22:08.152227 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 63/125] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:07 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1320 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:08.241412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-cfc0f9dc-0a9a-45c4-9bf5-662cb896dd63 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:08.242141 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-cfc0f9dc-0a9a-45c4-9bf5-662cb896dd63 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:08.249209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cfc0f9dc-0a9a-45c4-9bf5-662cb896dd63 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:08.249655 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cfc0f9dc-0a9a-45c4-9bf5-662cb896dd63 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:08.250432 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cfc0f9dc-0a9a-45c4-9bf5-662cb896dd63 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:08.250867 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cfc0f9dc-0a9a-45c4-9bf5-662cb896dd63 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:08.394587 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-cfc0f9dc-0a9a-45c4-9bf5-662cb896dd63 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:08.402210 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-cfc0f9dc-0a9a-45c4-9bf5-662cb896dd63 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1360 microversion: 2.1 time: 0.164766 Jun 07 14:22:08.402814 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 63/126] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:08 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1360 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:09.011417 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e500e488-1580-4f02-88c3-893cb3337345 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:09.012041 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e500e488-1580-4f02-88c3-893cb3337345 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:09.020176 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e500e488-1580-4f02-88c3-893cb3337345 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:09.020636 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e500e488-1580-4f02-88c3-893cb3337345 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:09.021455 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e500e488-1580-4f02-88c3-893cb3337345 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:09.021897 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e500e488-1580-4f02-88c3-893cb3337345 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:09.174473 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-52775d8b-4e86-48d9-8783-1b99a56a9d2e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:09.176058 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-52775d8b-4e86-48d9-8783-1b99a56a9d2e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:09.186412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-52775d8b-4e86-48d9-8783-1b99a56a9d2e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:09.187177 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-52775d8b-4e86-48d9-8783-1b99a56a9d2e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:09.188567 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-52775d8b-4e86-48d9-8783-1b99a56a9d2e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:09.189215 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-52775d8b-4e86-48d9-8783-1b99a56a9d2e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:09.195406 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e500e488-1580-4f02-88c3-893cb3337345 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:09.204866 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e500e488-1580-4f02-88c3-893cb3337345 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 0.197109 Jun 07 14:22:09.207594 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 64/127] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:09 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:09.328624 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-52775d8b-4e86-48d9-8783-1b99a56a9d2e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:09.336274 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-52775d8b-4e86-48d9-8783-1b99a56a9d2e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1320 microversion: 2.1 time: 0.167672 Jun 07 14:22:09.336943 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 64/128] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:09 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1320 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:22:09.420177 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6165d90d-49aa-42bb-b302-e8d90e6e630a tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:09.421596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-6165d90d-49aa-42bb-b302-e8d90e6e630a tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:09.427671 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6165d90d-49aa-42bb-b302-e8d90e6e630a tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:09.428137 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6165d90d-49aa-42bb-b302-e8d90e6e630a tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:09.428890 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6165d90d-49aa-42bb-b302-e8d90e6e630a tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:09.429322 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6165d90d-49aa-42bb-b302-e8d90e6e630a tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:09.568747 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-6165d90d-49aa-42bb-b302-e8d90e6e630a tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:09.576185 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6165d90d-49aa-42bb-b302-e8d90e6e630a tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1360 microversion: 2.1 time: 0.159820 Jun 07 14:22:09.577313 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 65/129] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:09 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:10.222460 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-367ebb14-2d70-4d7e-87d1-856ddc6e9e4a tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:10.223074 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-367ebb14-2d70-4d7e-87d1-856ddc6e9e4a tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:10.229333 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-367ebb14-2d70-4d7e-87d1-856ddc6e9e4a tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:10.229775 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-367ebb14-2d70-4d7e-87d1-856ddc6e9e4a tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:10.230528 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-367ebb14-2d70-4d7e-87d1-856ddc6e9e4a tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:10.230960 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-367ebb14-2d70-4d7e-87d1-856ddc6e9e4a tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:10.353252 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-eb6cb52d-fe57-430b-b543-4565baa8f05b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:10.353856 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-eb6cb52d-fe57-430b-b543-4565baa8f05b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:10.359842 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eb6cb52d-fe57-430b-b543-4565baa8f05b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:10.360327 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eb6cb52d-fe57-430b-b543-4565baa8f05b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:10.361151 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eb6cb52d-fe57-430b-b543-4565baa8f05b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:10.361583 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eb6cb52d-fe57-430b-b543-4565baa8f05b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:10.362616 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-367ebb14-2d70-4d7e-87d1-856ddc6e9e4a tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:10.370052 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-367ebb14-2d70-4d7e-87d1-856ddc6e9e4a tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 0.151562 Jun 07 14:22:10.370622 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 65/130] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:10 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:10.492314 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-eb6cb52d-fe57-430b-b543-4565baa8f05b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:10.500476 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-eb6cb52d-fe57-430b-b543-4565baa8f05b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1320 microversion: 2.1 time: 0.151360 Jun 07 14:22:10.501034 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 66/131] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:10 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1320 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:22:10.593829 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-87823e34-7bb7-4630-b17c-ff20f56f5593 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:10.594358 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-87823e34-7bb7-4630-b17c-ff20f56f5593 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:10.600911 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-87823e34-7bb7-4630-b17c-ff20f56f5593 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:10.601350 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-87823e34-7bb7-4630-b17c-ff20f56f5593 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:10.602102 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-87823e34-7bb7-4630-b17c-ff20f56f5593 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:10.602531 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-87823e34-7bb7-4630-b17c-ff20f56f5593 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:10.733689 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-87823e34-7bb7-4630-b17c-ff20f56f5593 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:10.741149 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-87823e34-7bb7-4630-b17c-ff20f56f5593 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1360 microversion: 2.1 time: 0.151540 Jun 07 14:22:10.741715 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 66/132] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:10 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:11.387684 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-4fa16922-b03c-46d5-9315-6c55ac179226 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:11.388226 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-4fa16922-b03c-46d5-9315-6c55ac179226 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:11.395085 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4fa16922-b03c-46d5-9315-6c55ac179226 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:11.395626 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4fa16922-b03c-46d5-9315-6c55ac179226 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:11.396375 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4fa16922-b03c-46d5-9315-6c55ac179226 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:11.396803 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4fa16922-b03c-46d5-9315-6c55ac179226 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:11.518094 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-e9cb6eed-63f7-4413-b55e-43de0224166b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:11.519008 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-e9cb6eed-63f7-4413-b55e-43de0224166b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:11.526045 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e9cb6eed-63f7-4413-b55e-43de0224166b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:11.526570 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e9cb6eed-63f7-4413-b55e-43de0224166b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:11.527471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e9cb6eed-63f7-4413-b55e-43de0224166b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:11.527973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e9cb6eed-63f7-4413-b55e-43de0224166b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:11.724353 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-e9cb6eed-63f7-4413-b55e-43de0224166b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:11.728246 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-4fa16922-b03c-46d5-9315-6c55ac179226 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:11.733837 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-e9cb6eed-63f7-4413-b55e-43de0224166b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1320 microversion: 2.1 time: 0.220494 Jun 07 14:22:11.734601 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 67/133] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:11 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1320 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:22:11.736479 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-4fa16922-b03c-46d5-9315-6c55ac179226 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 0.352629 Jun 07 14:22:11.737049 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 67/134] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:11 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:11.758233 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-020ea067-40e8-4b00-ab40-20d78a9066f7 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:11.758841 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-020ea067-40e8-4b00-ab40-20d78a9066f7 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:11.765023 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-020ea067-40e8-4b00-ab40-20d78a9066f7 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:11.765469 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-020ea067-40e8-4b00-ab40-20d78a9066f7 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:11.766222 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-020ea067-40e8-4b00-ab40-20d78a9066f7 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:11.766653 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-020ea067-40e8-4b00-ab40-20d78a9066f7 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:11.893210 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-020ea067-40e8-4b00-ab40-20d78a9066f7 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:11.900468 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-020ea067-40e8-4b00-ab40-20d78a9066f7 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1360 microversion: 2.1 time: 0.146145 Jun 07 14:22:11.901029 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 68/135] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:11 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1360 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:12.558293 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-d6c71786-bed5-4525-85e4-d2d61a1ec120 req-36e10df8-4683-4897-8270-126c05da537f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dd5700e-2891-4b99-ba1f-d5304a5c8f58", "name": "network-vif-plugged", "status": "completed", "tag": "7d9b7314-f274-43d0-925f-d9b6683e8642"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:22:12.570927 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-d6c71786-bed5-4525-85e4-d2d61a1ec120 req-36e10df8-4683-4897-8270-126c05da537f service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:12.571573 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-d6c71786-bed5-4525-85e4-d2d61a1ec120 req-36e10df8-4683-4897-8270-126c05da537f service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:12.585611 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-d6c71786-bed5-4525-85e4-d2d61a1ec120 req-36e10df8-4683-4897-8270-126c05da537f service nova] Creating event network-vif-plugged:7d9b7314-f274-43d0-925f-d9b6683e8642 for instance 4dd5700e-2891-4b99-ba1f-d5304a5c8f58 on hv-cinder-83608 Jun 07 14:22:12.591267 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-d6c71786-bed5-4525-85e4-d2d61a1ec120 req-36e10df8-4683-4897-8270-126c05da537f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038535 Jun 07 14:22:12.593211 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 68/136] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:22:12.750790 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7102f016-f907-4706-a110-ec7cf0cefdb5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:12.751543 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-7102f016-f907-4706-a110-ec7cf0cefdb5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:12.753851 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-10d7dd75-2feb-40ea-ab1b-56a7d5cfa1ed tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:12.754677 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-10d7dd75-2feb-40ea-ab1b-56a7d5cfa1ed tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:12.758100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7102f016-f907-4706-a110-ec7cf0cefdb5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:12.758554 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7102f016-f907-4706-a110-ec7cf0cefdb5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:12.759361 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7102f016-f907-4706-a110-ec7cf0cefdb5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:12.759807 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7102f016-f907-4706-a110-ec7cf0cefdb5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:12.761185 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-10d7dd75-2feb-40ea-ab1b-56a7d5cfa1ed tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:12.761649 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-10d7dd75-2feb-40ea-ab1b-56a7d5cfa1ed tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:12.762825 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-10d7dd75-2feb-40ea-ab1b-56a7d5cfa1ed tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:12.763253 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-10d7dd75-2feb-40ea-ab1b-56a7d5cfa1ed tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:12.964238 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-10d7dd75-2feb-40ea-ab1b-56a7d5cfa1ed tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:12.978157 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-7102f016-f907-4706-a110-ec7cf0cefdb5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:12.987927 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-7102f016-f907-4706-a110-ec7cf0cefdb5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1320 microversion: 2.1 time: 0.241238 Jun 07 14:22:12.988974 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 69/137] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:12 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1320 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:12.994507 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-77648167-8388-40fc-8f27-d19c123d3544 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:12.995699 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-77648167-8388-40fc-8f27-d19c123d3544 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:13.000794 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-10d7dd75-2feb-40ea-ab1b-56a7d5cfa1ed tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1314 microversion: 2.1 time: 0.251395 Jun 07 14:22:13.001521 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 69/138] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:12 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:22:13.002109 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-77648167-8388-40fc-8f27-d19c123d3544 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:13.002569 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-77648167-8388-40fc-8f27-d19c123d3544 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:13.003392 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-77648167-8388-40fc-8f27-d19c123d3544 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:13.003985 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-77648167-8388-40fc-8f27-d19c123d3544 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:13.149597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-77648167-8388-40fc-8f27-d19c123d3544 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:13.162942 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-77648167-8388-40fc-8f27-d19c123d3544 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1360 microversion: 2.1 time: 0.169273 Jun 07 14:22:13.163129 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 70/139] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:12 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1360 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:14.006098 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1ed26fa7-dc80-4f5f-9bed-045a021ed759 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:14.006676 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1ed26fa7-dc80-4f5f-9bed-045a021ed759 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:14.012895 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1ed26fa7-dc80-4f5f-9bed-045a021ed759 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:14.013382 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1ed26fa7-dc80-4f5f-9bed-045a021ed759 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:14.014538 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1ed26fa7-dc80-4f5f-9bed-045a021ed759 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:14.014950 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1ed26fa7-dc80-4f5f-9bed-045a021ed759 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:14.018417 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-6f1e5748-9626-4e32-bc5b-a8c53e1da991 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:14.019201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-6f1e5748-9626-4e32-bc5b-a8c53e1da991 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:14.025240 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6f1e5748-9626-4e32-bc5b-a8c53e1da991 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:14.025684 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6f1e5748-9626-4e32-bc5b-a8c53e1da991 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:14.026445 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6f1e5748-9626-4e32-bc5b-a8c53e1da991 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:14.026872 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6f1e5748-9626-4e32-bc5b-a8c53e1da991 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:14.217571 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-6f1e5748-9626-4e32-bc5b-a8c53e1da991 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:14.221202 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1ed26fa7-dc80-4f5f-9bed-045a021ed759 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:14.225751 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-6f1e5748-9626-4e32-bc5b-a8c53e1da991 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1500 microversion: 2.1 time: 0.211323 Jun 07 14:22:14.226333 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 71/140] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:14 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1500 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:22:14.229008 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1ed26fa7-dc80-4f5f-9bed-045a021ed759 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1513 microversion: 2.1 time: 0.227215 Jun 07 14:22:14.229717 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 70/141] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:14 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:14.237791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3bfe1c8b-4c38-4d4d-a39a-c6e531a8c298 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:14.237791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-3bfe1c8b-4c38-4d4d-a39a-c6e531a8c298 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:14.237791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3bfe1c8b-4c38-4d4d-a39a-c6e531a8c298 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:14.238071 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3bfe1c8b-4c38-4d4d-a39a-c6e531a8c298 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:14.238654 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3bfe1c8b-4c38-4d4d-a39a-c6e531a8c298 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:14.239088 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3bfe1c8b-4c38-4d4d-a39a-c6e531a8c298 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:14.246030 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-806b9d34-9464-4bab-8148-71d7c035ec29 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:22:14.247022 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-806b9d34-9464-4bab-8148-71d7c035ec29 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:14.254176 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-806b9d34-9464-4bab-8148-71d7c035ec29 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:14.254622 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-806b9d34-9464-4bab-8148-71d7c035ec29 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:14.255428 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-806b9d34-9464-4bab-8148-71d7c035ec29 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:14.256036 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-806b9d34-9464-4bab-8148-71d7c035ec29 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:14.325506 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-806b9d34-9464-4bab-8148-71d7c035ec29 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lazy-loading 'flavor' on Instance uuid 86529cf4-f4ef-45bc-9f34-e0d802dbd846 {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:22:14.440215 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-3bfe1c8b-4c38-4d4d-a39a-c6e531a8c298 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:14.442948 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=100 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:14.456033 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-3bfe1c8b-4c38-4d4d-a39a-c6e531a8c298 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1360 microversion: 2.1 time: 0.228248 Jun 07 14:22:14.457617 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 72/142] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:14 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1360 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:14.493927 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-806b9d34-9464-4bab-8148-71d7c035ec29 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "POST /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846/action" status: 200 len: 32 microversion: 2.1 time: 0.251743 Jun 07 14:22:14.495611 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 71/143] 10.222.0.81 () {60 vars in 1277 bytes} [Tue Jun 7 14:22:14 2022] POST /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846/action => generated 32 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 07 14:22:14.518401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7bb54cfe-0990-4252-9842-df4e44a309d7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:14.519299 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-7bb54cfe-0990-4252-9842-df4e44a309d7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:14.526155 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7bb54cfe-0990-4252-9842-df4e44a309d7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:14.527916 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7bb54cfe-0990-4252-9842-df4e44a309d7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:14.531883 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7bb54cfe-0990-4252-9842-df4e44a309d7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:14.532906 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7bb54cfe-0990-4252-9842-df4e44a309d7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:14.883042 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-7bb54cfe-0990-4252-9842-df4e44a309d7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:14.892588 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-7bb54cfe-0990-4252-9842-df4e44a309d7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.389799 Jun 07 14:22:14.893264 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 73/144] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:14 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:15.477119 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-4075ebd2-4049-454e-8868-b232d6d9f241 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:15.477937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-4075ebd2-4049-454e-8868-b232d6d9f241 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:15.487824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4075ebd2-4049-454e-8868-b232d6d9f241 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:15.487824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4075ebd2-4049-454e-8868-b232d6d9f241 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:15.487824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4075ebd2-4049-454e-8868-b232d6d9f241 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:15.488084 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4075ebd2-4049-454e-8868-b232d6d9f241 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:15.696232 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-4075ebd2-4049-454e-8868-b232d6d9f241 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:15.707423 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-4075ebd2-4049-454e-8868-b232d6d9f241 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1360 microversion: 2.1 time: 0.236510 Jun 07 14:22:15.707994 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 72/145] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:15 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1360 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:15.916649 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-33fc8c29-816f-4236-a9ce-8946c9c6bd05 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:15.923998 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-33fc8c29-816f-4236-a9ce-8946c9c6bd05 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:15.930681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-33fc8c29-816f-4236-a9ce-8946c9c6bd05 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:15.931139 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-33fc8c29-816f-4236-a9ce-8946c9c6bd05 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:15.940674 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-33fc8c29-816f-4236-a9ce-8946c9c6bd05 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:15.941316 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-33fc8c29-816f-4236-a9ce-8946c9c6bd05 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:15.993917 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-216ceb7e-3837-43c4-bcb6-71a05c34491a tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54614970-8059-4a0a-b3c7-ef63e28ee051"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:22:15.995102 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-216ceb7e-3837-43c4-bcb6-71a05c34491a tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:16.006310 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-216ceb7e-3837-43c4-bcb6-71a05c34491a tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:16.007420 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-216ceb7e-3837-43c4-bcb6-71a05c34491a tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:16.008852 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-216ceb7e-3837-43c4-bcb6-71a05c34491a tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:16.009412 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-216ceb7e-3837-43c4-bcb6-71a05c34491a tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:16.161106 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-33fc8c29-816f-4236-a9ce-8946c9c6bd05 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:16.169329 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-33fc8c29-816f-4236-a9ce-8946c9c6bd05 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.261440 Jun 07 14:22:16.170776 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 74/146] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:15 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:16.629620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-63c021e6-ad26-4a49-9e3d-732674be10c6 req-c4981274-4526-4915-b51d-c1a7a3359fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b", "name": "network-vif-plugged", "status": "completed", "tag": "3fcce599-f9f4-4a19-a2d1-e0608cd6435f"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:22:16.660706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-63c021e6-ad26-4a49-9e3d-732674be10c6 req-c4981274-4526-4915-b51d-c1a7a3359fb2 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:16.661337 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-63c021e6-ad26-4a49-9e3d-732674be10c6 req-c4981274-4526-4915-b51d-c1a7a3359fb2 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:16.677371 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-63c021e6-ad26-4a49-9e3d-732674be10c6 req-c4981274-4526-4915-b51d-c1a7a3359fb2 service nova] Creating event network-vif-plugged:3fcce599-f9f4-4a19-a2d1-e0608cd6435f for instance ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b on hv-cinder-83608 Jun 07 14:22:16.684269 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-63c021e6-ad26-4a49-9e3d-732674be10c6 req-c4981274-4526-4915-b51d-c1a7a3359fb2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059139 Jun 07 14:22:16.686115 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 75/147] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:22:16.726110 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7af4319f-a30a-418d-823a-2a90957cd552 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:16.726912 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-7af4319f-a30a-418d-823a-2a90957cd552 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:16.734949 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7af4319f-a30a-418d-823a-2a90957cd552 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:16.735682 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7af4319f-a30a-418d-823a-2a90957cd552 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:16.736599 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7af4319f-a30a-418d-823a-2a90957cd552 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:16.737185 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7af4319f-a30a-418d-823a-2a90957cd552 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:16.816406 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-216ceb7e-3837-43c4-bcb6-71a05c34491a tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "POST /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.825545 Jun 07 14:22:16.817780 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 73/148] 10.222.0.81 () {60 vars in 1322 bytes} [Tue Jun 7 14:22:15 2022] POST /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c/os-volume_attachments => generated 194 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:22:16.938161 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-7af4319f-a30a-418d-823a-2a90957cd552 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:16.949056 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-7af4319f-a30a-418d-823a-2a90957cd552 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1360 microversion: 2.1 time: 0.227953 Jun 07 14:22:16.950446 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 76/149] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:16 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1360 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:17.189730 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b8f105e5-71f4-4d2e-a2cc-2cbebf8c890d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:17.191683 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b8f105e5-71f4-4d2e-a2cc-2cbebf8c890d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:17.209660 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b8f105e5-71f4-4d2e-a2cc-2cbebf8c890d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:17.212898 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b8f105e5-71f4-4d2e-a2cc-2cbebf8c890d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:17.214034 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b8f105e5-71f4-4d2e-a2cc-2cbebf8c890d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:17.216351 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b8f105e5-71f4-4d2e-a2cc-2cbebf8c890d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:17.386091 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b8f105e5-71f4-4d2e-a2cc-2cbebf8c890d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:17.393867 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b8f105e5-71f4-4d2e-a2cc-2cbebf8c890d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.210293 Jun 07 14:22:17.394529 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 74/150] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:17 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:17.965909 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-2a3b339c-10ad-4c57-b518-19582c6ea5d0 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:17.966515 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-2a3b339c-10ad-4c57-b518-19582c6ea5d0 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:17.977430 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2a3b339c-10ad-4c57-b518-19582c6ea5d0 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:17.977885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2a3b339c-10ad-4c57-b518-19582c6ea5d0 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:17.978833 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2a3b339c-10ad-4c57-b518-19582c6ea5d0 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:17.979468 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2a3b339c-10ad-4c57-b518-19582c6ea5d0 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:18.145999 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-2a3b339c-10ad-4c57-b518-19582c6ea5d0 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:18.155501 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-2a3b339c-10ad-4c57-b518-19582c6ea5d0 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1360 microversion: 2.1 time: 0.193328 Jun 07 14:22:18.156084 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 77/151] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:17 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1360 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:18.412334 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e4467678-7003-4809-87d6-73ae97ef65c6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:18.412948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e4467678-7003-4809-87d6-73ae97ef65c6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:18.427388 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e4467678-7003-4809-87d6-73ae97ef65c6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:18.427779 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e4467678-7003-4809-87d6-73ae97ef65c6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:18.430966 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e4467678-7003-4809-87d6-73ae97ef65c6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:18.431471 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e4467678-7003-4809-87d6-73ae97ef65c6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:18.624843 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e4467678-7003-4809-87d6-73ae97ef65c6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:18.633090 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e4467678-7003-4809-87d6-73ae97ef65c6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.224480 Jun 07 14:22:18.636706 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 75/152] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:18 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:19.173275 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-133f3bcb-0fd2-4a76-8f0e-45f6b48b0b59 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:19.173906 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-133f3bcb-0fd2-4a76-8f0e-45f6b48b0b59 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:19.182562 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=78 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:19.184127 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-133f3bcb-0fd2-4a76-8f0e-45f6b48b0b59 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:19.184560 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-133f3bcb-0fd2-4a76-8f0e-45f6b48b0b59 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:19.185340 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-133f3bcb-0fd2-4a76-8f0e-45f6b48b0b59 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:19.186503 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-133f3bcb-0fd2-4a76-8f0e-45f6b48b0b59 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:19.421501 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-133f3bcb-0fd2-4a76-8f0e-45f6b48b0b59 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:19.430017 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-133f3bcb-0fd2-4a76-8f0e-45f6b48b0b59 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1360 microversion: 2.1 time: 0.261022 Jun 07 14:22:19.435566 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 78/153] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:19 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1360 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:19.653412 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b614b53e-400b-42c4-92e1-bffd31253bc1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:19.656502 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b614b53e-400b-42c4-92e1-bffd31253bc1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:19.664066 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=76 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:19.666333 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b614b53e-400b-42c4-92e1-bffd31253bc1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:19.666996 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b614b53e-400b-42c4-92e1-bffd31253bc1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:19.668583 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b614b53e-400b-42c4-92e1-bffd31253bc1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:19.669181 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b614b53e-400b-42c4-92e1-bffd31253bc1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:20.177724 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b614b53e-400b-42c4-92e1-bffd31253bc1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:20.191980 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b614b53e-400b-42c4-92e1-bffd31253bc1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.542790 Jun 07 14:22:20.193238 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 76/154] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:19 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:20.448186 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7c2e1e2a-dbba-4314-a7e2-b03646113dc3 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:20.449388 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-7c2e1e2a-dbba-4314-a7e2-b03646113dc3 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:20.456846 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7c2e1e2a-dbba-4314-a7e2-b03646113dc3 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:20.457301 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7c2e1e2a-dbba-4314-a7e2-b03646113dc3 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:20.458070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7c2e1e2a-dbba-4314-a7e2-b03646113dc3 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:20.458514 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7c2e1e2a-dbba-4314-a7e2-b03646113dc3 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:20.617663 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-7c2e1e2a-dbba-4314-a7e2-b03646113dc3 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:20.625778 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-7c2e1e2a-dbba-4314-a7e2-b03646113dc3 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1546 microversion: 2.1 time: 0.181961 Jun 07 14:22:20.626658 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 79/155] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:20 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1546 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:20.644976 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0cbe8b54-8cb9-4c35-89d1-e852894003e1 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:20.645769 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0cbe8b54-8cb9-4c35-89d1-e852894003e1 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:20.652256 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0cbe8b54-8cb9-4c35-89d1-e852894003e1 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:20.654879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0cbe8b54-8cb9-4c35-89d1-e852894003e1 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:20.656609 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0cbe8b54-8cb9-4c35-89d1-e852894003e1 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:20.657558 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0cbe8b54-8cb9-4c35-89d1-e852894003e1 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:20.751947 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0cbe8b54-8cb9-4c35-89d1-e852894003e1 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112950 Jun 07 14:22:20.752665 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 77/156] 10.222.0.81 () {58 vars in 1274 bytes} [Tue Jun 7 14:22:20 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:22:21.210603 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-6b98c4b7-3591-4329-b8a3-cbac8cb834f0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:21.211109 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-6b98c4b7-3591-4329-b8a3-cbac8cb834f0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:21.219592 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6b98c4b7-3591-4329-b8a3-cbac8cb834f0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:21.220596 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6b98c4b7-3591-4329-b8a3-cbac8cb834f0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:21.221804 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6b98c4b7-3591-4329-b8a3-cbac8cb834f0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:21.222399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6b98c4b7-3591-4329-b8a3-cbac8cb834f0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:21.452659 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-6b98c4b7-3591-4329-b8a3-cbac8cb834f0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:21.463982 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-6b98c4b7-3591-4329-b8a3-cbac8cb834f0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.259010 Jun 07 14:22:21.464800 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 80/157] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:21 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:22.483902 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ad42ddde-7c9a-4cd9-b34b-5e44ffa1a3ad tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:22.484623 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ad42ddde-7c9a-4cd9-b34b-5e44ffa1a3ad tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:22.497653 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ad42ddde-7c9a-4cd9-b34b-5e44ffa1a3ad tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:22.499536 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ad42ddde-7c9a-4cd9-b34b-5e44ffa1a3ad tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:22.500351 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ad42ddde-7c9a-4cd9-b34b-5e44ffa1a3ad tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:22.500805 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ad42ddde-7c9a-4cd9-b34b-5e44ffa1a3ad tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:22.509461 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:22.738970 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-be0f15b0-d9c1-44f6-bcdb-cf85819b0458 req-cc11e6de-b1c1-4415-b721-ab6a9dc73605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b", "tag": "3fcce599-f9f4-4a19-a2d1-e0608cd6435f"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:22:22.752865 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-be0f15b0-d9c1-44f6-bcdb-cf85819b0458 req-cc11e6de-b1c1-4415-b721-ab6a9dc73605 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:22.753278 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-be0f15b0-d9c1-44f6-bcdb-cf85819b0458 req-cc11e6de-b1c1-4415-b721-ab6a9dc73605 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:22.782415 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ad42ddde-7c9a-4cd9-b34b-5e44ffa1a3ad tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:22.789172 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-be0f15b0-d9c1-44f6-bcdb-cf85819b0458 req-cc11e6de-b1c1-4415-b721-ab6a9dc73605 service nova] Creating event network-changed:3fcce599-f9f4-4a19-a2d1-e0608cd6435f for instance ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b on hv-cinder-83608 Jun 07 14:22:22.799481 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ad42ddde-7c9a-4cd9-b34b-5e44ffa1a3ad tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.312196 Jun 07 14:22:22.799592 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-be0f15b0-d9c1-44f6-bcdb-cf85819b0458 req-cc11e6de-b1c1-4415-b721-ab6a9dc73605 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062332 Jun 07 14:22:22.799592 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 81/158] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:22:22.811340 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 78/159] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:22 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:23.813522 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-cdad463c-05e5-4202-aec6-d5f910e1307b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:23.814509 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-cdad463c-05e5-4202-aec6-d5f910e1307b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:23.823151 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cdad463c-05e5-4202-aec6-d5f910e1307b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:23.823927 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cdad463c-05e5-4202-aec6-d5f910e1307b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:23.824953 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cdad463c-05e5-4202-aec6-d5f910e1307b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:23.825582 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cdad463c-05e5-4202-aec6-d5f910e1307b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:24.083678 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-cdad463c-05e5-4202-aec6-d5f910e1307b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:24.096367 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-cdad463c-05e5-4202-aec6-d5f910e1307b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.287539 Jun 07 14:22:24.097130 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 82/160] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:23 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:25.116080 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f6791c85-8c97-4644-908e-102c2848c22e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:25.117644 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f6791c85-8c97-4644-908e-102c2848c22e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:25.137004 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f6791c85-8c97-4644-908e-102c2848c22e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:25.137646 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f6791c85-8c97-4644-908e-102c2848c22e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:25.139837 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f6791c85-8c97-4644-908e-102c2848c22e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:25.140546 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f6791c85-8c97-4644-908e-102c2848c22e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:25.328595 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f6791c85-8c97-4644-908e-102c2848c22e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:25.338702 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f6791c85-8c97-4644-908e-102c2848c22e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.228006 Jun 07 14:22:25.339647 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 79/161] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:25 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:26.355879 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-94e031f5-7778-4392-a2b1-c053af9a1825 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:26.357133 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-94e031f5-7778-4392-a2b1-c053af9a1825 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:26.363596 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-94e031f5-7778-4392-a2b1-c053af9a1825 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:26.364039 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-94e031f5-7778-4392-a2b1-c053af9a1825 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:26.364847 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-94e031f5-7778-4392-a2b1-c053af9a1825 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:26.365311 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-94e031f5-7778-4392-a2b1-c053af9a1825 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:26.552594 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-94e031f5-7778-4392-a2b1-c053af9a1825 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:26.563420 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-94e031f5-7778-4392-a2b1-c053af9a1825 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.210933 Jun 07 14:22:26.583583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 83/162] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:26 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:27.584451 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-57ede58f-c60e-44ca-8be9-ce9a4480b1a3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:27.585051 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-57ede58f-c60e-44ca-8be9-ce9a4480b1a3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:27.595385 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-57ede58f-c60e-44ca-8be9-ce9a4480b1a3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:27.595831 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-57ede58f-c60e-44ca-8be9-ce9a4480b1a3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:27.597939 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-57ede58f-c60e-44ca-8be9-ce9a4480b1a3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:27.598546 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-57ede58f-c60e-44ca-8be9-ce9a4480b1a3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:27.739674 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-57ede58f-c60e-44ca-8be9-ce9a4480b1a3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:27.747114 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-57ede58f-c60e-44ca-8be9-ce9a4480b1a3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.166970 Jun 07 14:22:27.749907 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 80/163] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:27 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:28.766713 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-721822e1-d4c0-4d86-bd39-917d8f6f168e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:28.767348 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-721822e1-d4c0-4d86-bd39-917d8f6f168e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:28.773286 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-721822e1-d4c0-4d86-bd39-917d8f6f168e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:28.773727 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-721822e1-d4c0-4d86-bd39-917d8f6f168e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:28.774473 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-721822e1-d4c0-4d86-bd39-917d8f6f168e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:28.774902 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-721822e1-d4c0-4d86-bd39-917d8f6f168e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:28.900474 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-721822e1-d4c0-4d86-bd39-917d8f6f168e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:28.908207 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-721822e1-d4c0-4d86-bd39-917d8f6f168e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.146212 Jun 07 14:22:28.908781 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 84/164] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:28 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:29.925922 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f2a07c3c-6f65-4b16-aa89-00e4b0ab9e8d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:29.926631 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f2a07c3c-6f65-4b16-aa89-00e4b0ab9e8d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:29.933282 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f2a07c3c-6f65-4b16-aa89-00e4b0ab9e8d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:29.933813 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f2a07c3c-6f65-4b16-aa89-00e4b0ab9e8d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:29.934646 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f2a07c3c-6f65-4b16-aa89-00e4b0ab9e8d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:29.935475 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f2a07c3c-6f65-4b16-aa89-00e4b0ab9e8d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:30.124163 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f2a07c3c-6f65-4b16-aa89-00e4b0ab9e8d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:30.132952 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f2a07c3c-6f65-4b16-aa89-00e4b0ab9e8d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.211677 Jun 07 14:22:30.133761 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 81/165] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:29 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:22:31.156982 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d386a9de-4a61-4e3f-a7ed-341d0e0f0351 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:31.157654 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-d386a9de-4a61-4e3f-a7ed-341d0e0f0351 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:31.167567 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d386a9de-4a61-4e3f-a7ed-341d0e0f0351 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:31.168018 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d386a9de-4a61-4e3f-a7ed-341d0e0f0351 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:31.170479 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d386a9de-4a61-4e3f-a7ed-341d0e0f0351 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:31.170863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d386a9de-4a61-4e3f-a7ed-341d0e0f0351 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:31.233546 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-cf7983ab-5d0c-4d94-b9da-ef00f93dccfa tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:31.233982 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-cf7983ab-5d0c-4d94-b9da-ef00f93dccfa tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:31.244581 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cf7983ab-5d0c-4d94-b9da-ef00f93dccfa tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:31.245323 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cf7983ab-5d0c-4d94-b9da-ef00f93dccfa tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:31.246826 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cf7983ab-5d0c-4d94-b9da-ef00f93dccfa tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:31.247414 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cf7983ab-5d0c-4d94-b9da-ef00f93dccfa tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:31.301537 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-cf7983ab-5d0c-4d94-b9da-ef00f93dccfa tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Going to try to terminate instance {{(pid=117564) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:22:31.360678 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-d386a9de-4a61-4e3f-a7ed-341d0e0f0351 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:31.369065 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-d386a9de-4a61-4e3f-a7ed-341d0e0f0351 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.219537 Jun 07 14:22:31.369728 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 85/166] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:31 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:31.406285 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-cf7983ab-5d0c-4d94-b9da-ef00f93dccfa tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "DELETE /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 204 len: 0 microversion: 2.1 time: 0.177570 Jun 07 14:22:31.407282 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 82/167] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:22:31 2022] DELETE /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:22:31.415379 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3ce23316-99c0-43a2-b99b-96d0008a6c4c tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:31.416213 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-3ce23316-99c0-43a2-b99b-96d0008a6c4c tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:31.424419 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3ce23316-99c0-43a2-b99b-96d0008a6c4c tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:31.425154 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3ce23316-99c0-43a2-b99b-96d0008a6c4c tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:31.425940 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3ce23316-99c0-43a2-b99b-96d0008a6c4c tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:31.426379 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3ce23316-99c0-43a2-b99b-96d0008a6c4c tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:31.572945 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-3ce23316-99c0-43a2-b99b-96d0008a6c4c tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:31.583617 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-3ce23316-99c0-43a2-b99b-96d0008a6c4c tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1552 microversion: 2.1 time: 0.172226 Jun 07 14:22:31.584558 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 86/168] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:31 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1552 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:32.387567 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-92604ccb-5ad6-4c95-bece-83c86ca33263 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:32.388899 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-92604ccb-5ad6-4c95-bece-83c86ca33263 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:32.396053 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-92604ccb-5ad6-4c95-bece-83c86ca33263 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:32.396576 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-92604ccb-5ad6-4c95-bece-83c86ca33263 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:32.397416 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-92604ccb-5ad6-4c95-bece-83c86ca33263 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:32.398070 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-92604ccb-5ad6-4c95-bece-83c86ca33263 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:32.533293 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-92604ccb-5ad6-4c95-bece-83c86ca33263 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:32.540734 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-92604ccb-5ad6-4c95-bece-83c86ca33263 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.157762 Jun 07 14:22:32.541295 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 83/169] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:32 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:32.601430 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-6b8aa166-6d92-4624-be62-4a2376d7582c tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:32.602047 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-6b8aa166-6d92-4624-be62-4a2376d7582c tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:32.608636 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6b8aa166-6d92-4624-be62-4a2376d7582c tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:32.609086 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6b8aa166-6d92-4624-be62-4a2376d7582c tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:32.609848 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6b8aa166-6d92-4624-be62-4a2376d7582c tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:32.610297 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6b8aa166-6d92-4624-be62-4a2376d7582c tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:32.794074 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-6b8aa166-6d92-4624-be62-4a2376d7582c tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:32.803750 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-6b8aa166-6d92-4624-be62-4a2376d7582c tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1552 microversion: 2.1 time: 0.206102 Jun 07 14:22:32.804695 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 87/170] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:32 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1552 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:33.560688 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-04cb8130-8f84-4eb8-a6d6-1d61a5a9add7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:33.561429 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-04cb8130-8f84-4eb8-a6d6-1d61a5a9add7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:33.568973 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-04cb8130-8f84-4eb8-a6d6-1d61a5a9add7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:33.569431 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-04cb8130-8f84-4eb8-a6d6-1d61a5a9add7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:33.570212 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-04cb8130-8f84-4eb8-a6d6-1d61a5a9add7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:33.570651 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-04cb8130-8f84-4eb8-a6d6-1d61a5a9add7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:33.710565 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-04cb8130-8f84-4eb8-a6d6-1d61a5a9add7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:33.719097 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-04cb8130-8f84-4eb8-a6d6-1d61a5a9add7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.162837 Jun 07 14:22:33.719702 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 84/171] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:33 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:33.823319 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-396e2a4b-5f41-48c1-806f-b9dfc99ca122 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:33.824245 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-396e2a4b-5f41-48c1-806f-b9dfc99ca122 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:33.831723 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-396e2a4b-5f41-48c1-806f-b9dfc99ca122 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:33.832175 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-396e2a4b-5f41-48c1-806f-b9dfc99ca122 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:33.832992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-396e2a4b-5f41-48c1-806f-b9dfc99ca122 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:33.833427 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-396e2a4b-5f41-48c1-806f-b9dfc99ca122 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:33.976254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-396e2a4b-5f41-48c1-806f-b9dfc99ca122 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:33.985796 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-396e2a4b-5f41-48c1-806f-b9dfc99ca122 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1552 microversion: 2.1 time: 0.166009 Jun 07 14:22:33.986848 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 88/172] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:33 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1552 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:34.745924 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-80812802-1d44-4d88-a240-ea7562fc12f8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:34.746637 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-80812802-1d44-4d88-a240-ea7562fc12f8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:34.753625 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-80812802-1d44-4d88-a240-ea7562fc12f8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:34.754079 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-80812802-1d44-4d88-a240-ea7562fc12f8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:34.755049 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-80812802-1d44-4d88-a240-ea7562fc12f8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:34.755523 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-80812802-1d44-4d88-a240-ea7562fc12f8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:34.898573 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-80812802-1d44-4d88-a240-ea7562fc12f8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:34.906943 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-80812802-1d44-4d88-a240-ea7562fc12f8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.174623 Jun 07 14:22:34.907556 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 85/173] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:34 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:35.004591 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-e3ce6884-e08c-4b02-a39d-93d85494a421 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:35.005203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-e3ce6884-e08c-4b02-a39d-93d85494a421 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:35.011152 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e3ce6884-e08c-4b02-a39d-93d85494a421 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:35.011632 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e3ce6884-e08c-4b02-a39d-93d85494a421 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:35.012395 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e3ce6884-e08c-4b02-a39d-93d85494a421 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:35.012829 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e3ce6884-e08c-4b02-a39d-93d85494a421 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:35.144523 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-e3ce6884-e08c-4b02-a39d-93d85494a421 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:35.157889 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-e3ce6884-e08c-4b02-a39d-93d85494a421 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1552 microversion: 2.1 time: 0.156899 Jun 07 14:22:35.158748 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 89/174] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:34 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:35.924272 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ed495377-7620-4f8c-875f-9f350a2ee28d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:35.924888 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ed495377-7620-4f8c-875f-9f350a2ee28d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:35.931551 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ed495377-7620-4f8c-875f-9f350a2ee28d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:35.932004 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ed495377-7620-4f8c-875f-9f350a2ee28d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:35.932779 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ed495377-7620-4f8c-875f-9f350a2ee28d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:35.933223 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ed495377-7620-4f8c-875f-9f350a2ee28d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:36.077411 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ed495377-7620-4f8c-875f-9f350a2ee28d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:36.085258 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ed495377-7620-4f8c-875f-9f350a2ee28d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.164775 Jun 07 14:22:36.085767 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 86/175] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:35 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:36.175597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-f907bd90-49b2-4551-b58a-b07e4e120270 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:36.176219 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-f907bd90-49b2-4551-b58a-b07e4e120270 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:36.182211 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f907bd90-49b2-4551-b58a-b07e4e120270 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:36.182661 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f907bd90-49b2-4551-b58a-b07e4e120270 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:36.183455 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f907bd90-49b2-4551-b58a-b07e4e120270 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:36.183927 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f907bd90-49b2-4551-b58a-b07e4e120270 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:36.326876 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-f907bd90-49b2-4551-b58a-b07e4e120270 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:36.329212 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=100 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:36.336410 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-f907bd90-49b2-4551-b58a-b07e4e120270 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1552 microversion: 2.1 time: 0.164563 Jun 07 14:22:36.336918 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 90/176] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:36 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:22:37.102531 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-547aabf3-584f-4b57-8ab4-2729de011b16 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:37.103144 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-547aabf3-584f-4b57-8ab4-2729de011b16 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:37.109794 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-547aabf3-584f-4b57-8ab4-2729de011b16 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:37.110242 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-547aabf3-584f-4b57-8ab4-2729de011b16 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:37.110999 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-547aabf3-584f-4b57-8ab4-2729de011b16 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:37.111480 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-547aabf3-584f-4b57-8ab4-2729de011b16 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:37.241771 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-547aabf3-584f-4b57-8ab4-2729de011b16 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:37.249875 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-547aabf3-584f-4b57-8ab4-2729de011b16 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.151452 Jun 07 14:22:37.250429 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 87/177] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:37 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:37.353887 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-cf9ddf5d-b0f0-463c-b55b-f99632e25b31 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:37.354496 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-cf9ddf5d-b0f0-463c-b55b-f99632e25b31 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:37.361204 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cf9ddf5d-b0f0-463c-b55b-f99632e25b31 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:37.361650 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cf9ddf5d-b0f0-463c-b55b-f99632e25b31 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:37.362401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cf9ddf5d-b0f0-463c-b55b-f99632e25b31 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:37.362829 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cf9ddf5d-b0f0-463c-b55b-f99632e25b31 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:37.492995 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-cf9ddf5d-b0f0-463c-b55b-f99632e25b31 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:37.501823 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-cf9ddf5d-b0f0-463c-b55b-f99632e25b31 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1552 microversion: 2.1 time: 0.151977 Jun 07 14:22:37.502409 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 91/178] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:37 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:38.266689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-626241d8-f04d-4965-8b0b-4cea26814238 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:38.267316 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-626241d8-f04d-4965-8b0b-4cea26814238 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:38.273736 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-626241d8-f04d-4965-8b0b-4cea26814238 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:38.274215 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-626241d8-f04d-4965-8b0b-4cea26814238 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:38.274969 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-626241d8-f04d-4965-8b0b-4cea26814238 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:38.275436 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-626241d8-f04d-4965-8b0b-4cea26814238 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:38.405513 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-626241d8-f04d-4965-8b0b-4cea26814238 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:38.412846 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-626241d8-f04d-4965-8b0b-4cea26814238 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.150855 Jun 07 14:22:38.413410 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 88/179] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:38 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:38.518605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-fe840fce-0bd0-461d-ab85-3ca748b7e902 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:38.519236 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-fe840fce-0bd0-461d-ab85-3ca748b7e902 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:38.525366 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fe840fce-0bd0-461d-ab85-3ca748b7e902 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:38.525815 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fe840fce-0bd0-461d-ab85-3ca748b7e902 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:38.526576 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fe840fce-0bd0-461d-ab85-3ca748b7e902 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:38.527012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fe840fce-0bd0-461d-ab85-3ca748b7e902 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:38.653668 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-fe840fce-0bd0-461d-ab85-3ca748b7e902 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:38.662330 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-fe840fce-0bd0-461d-ab85-3ca748b7e902 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1552 microversion: 2.1 time: 0.147640 Jun 07 14:22:38.662894 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 92/180] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:38 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:39.429490 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-68b3fc6a-92ff-4e05-8340-7801e65398d3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:39.430105 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-68b3fc6a-92ff-4e05-8340-7801e65398d3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:39.437363 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-68b3fc6a-92ff-4e05-8340-7801e65398d3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:39.437808 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-68b3fc6a-92ff-4e05-8340-7801e65398d3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:39.438586 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-68b3fc6a-92ff-4e05-8340-7801e65398d3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:39.439024 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-68b3fc6a-92ff-4e05-8340-7801e65398d3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:39.581843 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-68b3fc6a-92ff-4e05-8340-7801e65398d3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:39.590691 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-68b3fc6a-92ff-4e05-8340-7801e65398d3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.165184 Jun 07 14:22:39.601104 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 89/181] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:39 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:39.679242 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-e3c14ce6-2d04-42c1-b275-581a7dfe0293 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:39.679890 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-e3c14ce6-2d04-42c1-b275-581a7dfe0293 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:39.686024 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e3c14ce6-2d04-42c1-b275-581a7dfe0293 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:39.686471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e3c14ce6-2d04-42c1-b275-581a7dfe0293 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:39.687242 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e3c14ce6-2d04-42c1-b275-581a7dfe0293 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:39.687703 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e3c14ce6-2d04-42c1-b275-581a7dfe0293 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:39.817414 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-e3c14ce6-2d04-42c1-b275-581a7dfe0293 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:39.825505 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-e3c14ce6-2d04-42c1-b275-581a7dfe0293 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1552 microversion: 2.1 time: 0.150006 Jun 07 14:22:39.826079 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 93/182] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:39 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:40.609846 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0a6a128e-7cd3-405e-a447-5487c58a4023 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:40.610454 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0a6a128e-7cd3-405e-a447-5487c58a4023 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:40.616976 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0a6a128e-7cd3-405e-a447-5487c58a4023 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:40.617422 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0a6a128e-7cd3-405e-a447-5487c58a4023 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:40.618442 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0a6a128e-7cd3-405e-a447-5487c58a4023 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:40.619349 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0a6a128e-7cd3-405e-a447-5487c58a4023 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:40.751663 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0a6a128e-7cd3-405e-a447-5487c58a4023 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:40.758999 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0a6a128e-7cd3-405e-a447-5487c58a4023 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.153926 Jun 07 14:22:40.759599 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 90/183] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:40 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:40.843176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-27ba8eda-780e-4c7f-adac-5b0db273f5e0 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:40.843745 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-27ba8eda-780e-4c7f-adac-5b0db273f5e0 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:40.849935 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-27ba8eda-780e-4c7f-adac-5b0db273f5e0 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:40.850383 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-27ba8eda-780e-4c7f-adac-5b0db273f5e0 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:40.851134 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-27ba8eda-780e-4c7f-adac-5b0db273f5e0 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:40.851593 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-27ba8eda-780e-4c7f-adac-5b0db273f5e0 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:40.984292 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-27ba8eda-780e-4c7f-adac-5b0db273f5e0 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:40.992291 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-27ba8eda-780e-4c7f-adac-5b0db273f5e0 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1552 microversion: 2.1 time: 0.153800 Jun 07 14:22:40.992852 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 94/184] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:40 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:41.776254 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-4e706d4e-acd9-4211-8b47-a198299d04cd tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:41.776891 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-4e706d4e-acd9-4211-8b47-a198299d04cd tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:41.783670 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4e706d4e-acd9-4211-8b47-a198299d04cd tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:41.784114 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4e706d4e-acd9-4211-8b47-a198299d04cd tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:41.784864 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4e706d4e-acd9-4211-8b47-a198299d04cd tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:41.785301 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4e706d4e-acd9-4211-8b47-a198299d04cd tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:41.909010 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-4e706d4e-acd9-4211-8b47-a198299d04cd tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:41.916380 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-4e706d4e-acd9-4211-8b47-a198299d04cd tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.143886 Jun 07 14:22:41.916949 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 91/185] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:41 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:42.008746 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-aca0abce-fed1-4250-a4f6-aa1147b04ba7 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:42.009370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-aca0abce-fed1-4250-a4f6-aa1147b04ba7 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:42.015595 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-aca0abce-fed1-4250-a4f6-aa1147b04ba7 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:42.016038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-aca0abce-fed1-4250-a4f6-aa1147b04ba7 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:42.016796 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-aca0abce-fed1-4250-a4f6-aa1147b04ba7 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:42.017226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-aca0abce-fed1-4250-a4f6-aa1147b04ba7 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:42.147999 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-aca0abce-fed1-4250-a4f6-aa1147b04ba7 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:42.156558 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-aca0abce-fed1-4250-a4f6-aa1147b04ba7 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1552 microversion: 2.1 time: 0.151566 Jun 07 14:22:42.157127 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 95/186] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:42 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:42.933388 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2eacaa68-fe72-4e55-82d6-be8144eab85a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:42.934005 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2eacaa68-fe72-4e55-82d6-be8144eab85a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:42.940533 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2eacaa68-fe72-4e55-82d6-be8144eab85a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:42.940983 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2eacaa68-fe72-4e55-82d6-be8144eab85a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:42.941745 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2eacaa68-fe72-4e55-82d6-be8144eab85a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:42.942185 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2eacaa68-fe72-4e55-82d6-be8144eab85a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:43.076259 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2eacaa68-fe72-4e55-82d6-be8144eab85a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:43.084064 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2eacaa68-fe72-4e55-82d6-be8144eab85a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.154475 Jun 07 14:22:43.084683 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 92/187] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:42 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:43.174148 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-6c09cdaf-9991-48d9-af39-684cff1496b8 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:43.174899 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-6c09cdaf-9991-48d9-af39-684cff1496b8 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:43.181239 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6c09cdaf-9991-48d9-af39-684cff1496b8 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:43.181685 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6c09cdaf-9991-48d9-af39-684cff1496b8 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:43.182622 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6c09cdaf-9991-48d9-af39-684cff1496b8 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:43.183050 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6c09cdaf-9991-48d9-af39-684cff1496b8 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:43.310344 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-6c09cdaf-9991-48d9-af39-684cff1496b8 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:43.318343 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-6c09cdaf-9991-48d9-af39-684cff1496b8 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1552 microversion: 2.1 time: 0.148467 Jun 07 14:22:43.318916 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 96/188] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:43 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:44.100806 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6c44cdee-aabb-444c-a79a-c1f4d39bbcaa tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:44.101423 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-6c44cdee-aabb-444c-a79a-c1f4d39bbcaa tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:44.108687 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6c44cdee-aabb-444c-a79a-c1f4d39bbcaa tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:44.109140 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6c44cdee-aabb-444c-a79a-c1f4d39bbcaa tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:44.110113 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6c44cdee-aabb-444c-a79a-c1f4d39bbcaa tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:44.110556 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6c44cdee-aabb-444c-a79a-c1f4d39bbcaa tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:44.116629 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:44.269441 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-8bc9422a-3367-44e3-b080-c397f92079cb req-c60f89e9-62df-490b-95ce-626c6bbf891d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09792bed-de41-489d-8ab2-6a1bc9ac884c", "name": "network-vif-deleted", "tag": "1652612a-9961-4ecf-8744-a03edaa82b75"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:22:44.283483 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-8bc9422a-3367-44e3-b080-c397f92079cb req-c60f89e9-62df-490b-95ce-626c6bbf891d service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:44.284172 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-8bc9422a-3367-44e3-b080-c397f92079cb req-c60f89e9-62df-490b-95ce-626c6bbf891d service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:44.300404 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-8bc9422a-3367-44e3-b080-c397f92079cb req-c60f89e9-62df-490b-95ce-626c6bbf891d service nova] Creating event network-vif-deleted:1652612a-9961-4ecf-8744-a03edaa82b75 for instance 09792bed-de41-489d-8ab2-6a1bc9ac884c on hv-cinder-83608 Jun 07 14:22:44.306296 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-8bc9422a-3367-44e3-b080-c397f92079cb req-c60f89e9-62df-490b-95ce-626c6bbf891d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040357 Jun 07 14:22:44.307769 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 97/189] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:22:44.337130 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d8b04d81-e9fa-481a-9d30-24b3fb3b59e8 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:44.337911 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-d8b04d81-e9fa-481a-9d30-24b3fb3b59e8 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:44.345252 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d8b04d81-e9fa-481a-9d30-24b3fb3b59e8 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:44.352043 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d8b04d81-e9fa-481a-9d30-24b3fb3b59e8 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:44.353118 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d8b04d81-e9fa-481a-9d30-24b3fb3b59e8 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:44.353771 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d8b04d81-e9fa-481a-9d30-24b3fb3b59e8 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:44.365283 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-6c44cdee-aabb-444c-a79a-c1f4d39bbcaa tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:44.373164 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6c44cdee-aabb-444c-a79a-c1f4d39bbcaa tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.276457 Jun 07 14:22:44.375263 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 93/190] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:44 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:44.436714 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-d8b04d81-e9fa-481a-9d30-24b3fb3b59e8 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:44.444741 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-d8b04d81-e9fa-481a-9d30-24b3fb3b59e8 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1345 microversion: 2.1 time: 0.112282 Jun 07 14:22:44.445307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 98/191] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:44 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1345 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:22:45.392278 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-4cc0f5bd-93fc-46a1-8331-21da98c8f584 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:45.393633 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-4cc0f5bd-93fc-46a1-8331-21da98c8f584 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:45.402261 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4cc0f5bd-93fc-46a1-8331-21da98c8f584 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:45.402926 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4cc0f5bd-93fc-46a1-8331-21da98c8f584 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:45.404544 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4cc0f5bd-93fc-46a1-8331-21da98c8f584 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:45.405183 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4cc0f5bd-93fc-46a1-8331-21da98c8f584 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:45.470224 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-e5780870-c505-4ab6-99da-424b8691aa9f tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:45.473267 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-e5780870-c505-4ab6-99da-424b8691aa9f tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:45.499933 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e5780870-c505-4ab6-99da-424b8691aa9f tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:45.500611 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e5780870-c505-4ab6-99da-424b8691aa9f tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:45.501617 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e5780870-c505-4ab6-99da-424b8691aa9f tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:45.502126 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e5780870-c505-4ab6-99da-424b8691aa9f tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:45.554645 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e5780870-c505-4ab6-99da-424b8691aa9f tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:45.555455 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e5780870-c505-4ab6-99da-424b8691aa9f tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:45.556127 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.objects.instance [None req-e5780870-c505-4ab6-99da-424b8691aa9f tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lazy-loading 'fault' on Instance uuid 09792bed-de41-489d-8ab2-6a1bc9ac884c {{(pid=117565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:22:45.619061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-e5780870-c505-4ab6-99da-424b8691aa9f tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936db0436820496ebf8cc741852dda10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da54606acd24962be630e28ff636d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:45.640883 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-e5780870-c505-4ab6-99da-424b8691aa9f tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 200 len: 1350 microversion: 2.1 time: 0.182357 Jun 07 14:22:45.641484 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 99/192] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:45 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 1350 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:45.661702 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-4cc0f5bd-93fc-46a1-8331-21da98c8f584 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:45.671964 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-4cc0f5bd-93fc-46a1-8331-21da98c8f584 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.285686 Jun 07 14:22:45.672794 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 94/193] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:45 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:46.657948 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7c68ce35-6fa4-45d9-b550-cbaf1cc33571 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:46.658568 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-7c68ce35-6fa4-45d9-b550-cbaf1cc33571 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:46.665047 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7c68ce35-6fa4-45d9-b550-cbaf1cc33571 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:46.665498 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7c68ce35-6fa4-45d9-b550-cbaf1cc33571 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:46.666359 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7c68ce35-6fa4-45d9-b550-cbaf1cc33571 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:46.666798 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7c68ce35-6fa4-45d9-b550-cbaf1cc33571 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:46.681237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-7c68ce35-6fa4-45d9-b550-cbaf1cc33571 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] HTTP exception thrown: Instance 09792bed-de41-489d-8ab2-6a1bc9ac884c could not be found. Jun 07 14:22:46.687272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7c68ce35-6fa4-45d9-b550-cbaf1cc33571 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Request method failure captured: Jun 07 14:22:46.687272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c HTTP/1.1 Jun 07 14:22:46.687272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:22:46.687272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:22:46.687272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:22:46.687272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:22:46.687272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:22:46.687272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:22:46.687272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:22:46.687272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:22:46.687272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin17fqHNGjQulX3wNXiHSGKban-HcuZjEmlzpovq7Lprk7Vq0CwzKO8hqHDgTsHxrhTR_5iA7JccFf6tiPqaYd95kRaHBM9CWvpyksUJlF48VnZ3cv3W-CNSQI7PLcV_Nq4swlKXnP3XqCYSQ1gu09FgyvYxHaUj6gF5TiY9kK25V4XU Jun 07 14:22:46.687272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:22:46.687272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:22:46.687272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:22:46.687272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:22:46.687272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:22:46.687272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:22:46.687272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: 5da54606acd24962be630e28ff636d72 Jun 07 14:22:46.687272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-DeleteServersTestJSON-1287933540 Jun 07 14:22:46.687272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:22:46.687272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:22:46.688767 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5da54606acd24962be630e28ff636d72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5da54606acd24962be630e28ff636d72", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5da54606acd24962be630e28ff636d72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5da54606acd24962be630e28ff636d72"}]}] Jun 07 14:22:46.688767 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-DeleteServersTestJSON-1287933540 Jun 07 14:22:46.688767 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: 5da54606acd24962be630e28ff636d72 Jun 07 14:22:46.688767 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-DeleteServersTestJSON-1287933540 Jun 07 14:22:46.688767 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-DeleteServersTestJSON-1287933540-project Jun 07 14:22:46.688767 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:22:46.688767 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:22:46.688767 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: 936db0436820496ebf8cc741852dda10 Jun 07 14:22:46.688767 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-DeleteServersTestJSON-1287933540-project Jun 07 14:22:46.688767 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:22:46.688767 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance 09792bed-de41-489d-8ab2-6a1bc9ac884c could not be found. Jun 07 14:22:46.688767 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': '09792bed-de41-489d-8ab2-6a1bc9ac884c'} Jun 07 14:22:46.689639 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:22:46.689639 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:22:46.689639 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:22:46.689639 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:22:46.689639 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:22:46.689639 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:22:46.689639 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:22:46.689639 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:22:46.689639 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:22:46.689639 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:22:46.689639 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09792bed-de41-489d-8ab2-6a1bc9ac884c could not be found. Jun 07 14:22:46.689639 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:22:46.689639 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:22:46.689639 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:22:46.689639 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:22:46.689639 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:22:46.689639 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:22:46.689639 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:22:46.689639 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:22:46.689639 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:22:46.691004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:22:46.691004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:22:46.691004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:22:46.691004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:22:46.691004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:22:46.691004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:22:46.691004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:22:46.691004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09792bed-de41-489d-8ab2-6a1bc9ac884c could not be found. Jun 07 14:22:46.691004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:22:46.691004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:22:46.691004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:22:46.691004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:22:46.691004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:22:46.691004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:22:46.691004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:22:46.691004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:22:46.691004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09792bed-de41-489d-8ab2-6a1bc9ac884c could not be found. Jun 07 14:22:46.691004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:22:46.692403 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2d7c3833-cd52-497c-8a01-7ca9cd8bde3b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:46.692403 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2d7c3833-cd52-497c-8a01-7ca9cd8bde3b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:46.693793 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7c68ce35-6fa4-45d9-b550-cbaf1cc33571 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Returning 404 to user: Instance 09792bed-de41-489d-8ab2-6a1bc9ac884c could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:22:46.697352 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2d7c3833-cd52-497c-8a01-7ca9cd8bde3b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:46.698005 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2d7c3833-cd52-497c-8a01-7ca9cd8bde3b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:46.698919 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2d7c3833-cd52-497c-8a01-7ca9cd8bde3b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:46.699540 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2d7c3833-cd52-497c-8a01-7ca9cd8bde3b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:46.704706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-7c68ce35-6fa4-45d9-b550-cbaf1cc33571 tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 404 len: 111 microversion: 2.1 time: 0.040882 Jun 07 14:22:46.708323 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 100/194] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:46 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:22:46.894369 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-4925649d-1427-4be3-a13b-f74f391608bc tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:46.896095 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-4925649d-1427-4be3-a13b-f74f391608bc tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:46.902470 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2d7c3833-cd52-497c-8a01-7ca9cd8bde3b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:46.914009 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2d7c3833-cd52-497c-8a01-7ca9cd8bde3b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.227537 Jun 07 14:22:46.924056 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4925649d-1427-4be3-a13b-f74f391608bc tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:46.924056 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4925649d-1427-4be3-a13b-f74f391608bc tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:46.924056 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4925649d-1427-4be3-a13b-f74f391608bc tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:46.924056 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4925649d-1427-4be3-a13b-f74f391608bc tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:46.926446 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 95/195] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:46 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:46.998753 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-4925649d-1427-4be3-a13b-f74f391608bc tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] HTTP exception thrown: Instance 09792bed-de41-489d-8ab2-6a1bc9ac884c could not be found. Jun 07 14:22:47.000923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-4925649d-1427-4be3-a13b-f74f391608bc tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Request method failure captured: Jun 07 14:22:47.000923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c/os-volume_attachments HTTP/1.1 Jun 07 14:22:47.000923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:22:47.000923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:22:47.000923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:22:47.000923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:22:47.000923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:22:47.000923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:22:47.000923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:22:47.000923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:22:47.000923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin17fqHNGjQulX3wNXiHSGKban-HcuZjEmlzpovq7Lprk7Vq0CwzKO8hqHDgTsHxrhTR_5iA7JccFf6tiPqaYd95kRaHBM9CWvpyksUJlF48VnZ3cv3W-CNSQI7PLcV_Nq4swlKXnP3XqCYSQ1gu09FgyvYxHaUj6gF5TiY9kK25V4XU Jun 07 14:22:47.000923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:22:47.000923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:22:47.000923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:22:47.000923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:22:47.000923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:22:47.000923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:22:47.000923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: 5da54606acd24962be630e28ff636d72 Jun 07 14:22:47.000923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-DeleteServersTestJSON-1287933540 Jun 07 14:22:47.000923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:22:47.000923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:22:47.002676 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5da54606acd24962be630e28ff636d72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5da54606acd24962be630e28ff636d72", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5da54606acd24962be630e28ff636d72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5da54606acd24962be630e28ff636d72"}]}] Jun 07 14:22:47.002676 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-DeleteServersTestJSON-1287933540 Jun 07 14:22:47.002676 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: 5da54606acd24962be630e28ff636d72 Jun 07 14:22:47.002676 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-DeleteServersTestJSON-1287933540 Jun 07 14:22:47.002676 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-DeleteServersTestJSON-1287933540-project Jun 07 14:22:47.002676 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:22:47.002676 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:22:47.002676 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: 936db0436820496ebf8cc741852dda10 Jun 07 14:22:47.002676 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-DeleteServersTestJSON-1287933540-project Jun 07 14:22:47.002676 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:22:47.002676 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance 09792bed-de41-489d-8ab2-6a1bc9ac884c could not be found. Jun 07 14:22:47.002676 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'server_id': '09792bed-de41-489d-8ab2-6a1bc9ac884c'} Jun 07 14:22:47.003532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:22:47.003532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:22:47.003532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:22:47.003532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:22:47.003532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:22:47.003532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:22:47.003532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:22:47.003532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:22:47.003532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:22:47.003532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:22:47.003532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09792bed-de41-489d-8ab2-6a1bc9ac884c could not be found. Jun 07 14:22:47.003532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:22:47.003532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:22:47.003532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:22:47.003532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:22:47.003532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:22:47.003532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:22:47.003532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:22:47.003532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:22:47.003532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:22:47.004858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:22:47.004858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 07 14:22:47.004858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 14:22:47.004858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 07 14:22:47.004858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 14:22:47.004858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 07 14:22:47.004858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 07 14:22:47.004858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:22:47.004858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:22:47.004858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09792bed-de41-489d-8ab2-6a1bc9ac884c could not be found. Jun 07 14:22:47.004858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:22:47.004858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:22:47.004858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:22:47.004858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:22:47.004858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:22:47.004858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:22:47.004858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:22:47.004858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:22:47.004858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09792bed-de41-489d-8ab2-6a1bc9ac884c could not be found. Jun 07 14:22:47.004858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:22:47.007683 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-4925649d-1427-4be3-a13b-f74f391608bc tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Returning 404 to user: Instance 09792bed-de41-489d-8ab2-6a1bc9ac884c could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:22:47.008770 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-4925649d-1427-4be3-a13b-f74f391608bc tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.119117 Jun 07 14:22:47.009795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 101/196] 10.222.0.81 () {58 vars in 1301 bytes} [Tue Jun 7 14:22:46 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c/os-volume_attachments => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:22:47.931914 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a86059f5-4c21-4b21-98a8-d8841798cd1d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:47.932669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a86059f5-4c21-4b21-98a8-d8841798cd1d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:47.940420 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a86059f5-4c21-4b21-98a8-d8841798cd1d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:47.940927 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a86059f5-4c21-4b21-98a8-d8841798cd1d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:47.941586 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a86059f5-4c21-4b21-98a8-d8841798cd1d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:47.942262 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a86059f5-4c21-4b21-98a8-d8841798cd1d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:48.143282 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a86059f5-4c21-4b21-98a8-d8841798cd1d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:48.152688 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a86059f5-4c21-4b21-98a8-d8841798cd1d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.224952 Jun 07 14:22:48.162727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 96/197] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:47 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:48.307701 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-bbfb10fe-5459-4892-b962-b09b1528a0ea tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:48.308199 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-bbfb10fe-5459-4892-b962-b09b1528a0ea tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:48.330413 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bbfb10fe-5459-4892-b962-b09b1528a0ea tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:48.330789 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bbfb10fe-5459-4892-b962-b09b1528a0ea tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:48.333260 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bbfb10fe-5459-4892-b962-b09b1528a0ea tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:48.333711 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bbfb10fe-5459-4892-b962-b09b1528a0ea tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:48.358885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-bbfb10fe-5459-4892-b962-b09b1528a0ea tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] HTTP exception thrown: Instance 09792bed-de41-489d-8ab2-6a1bc9ac884c could not be found. Jun 07 14:22:48.360730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-bbfb10fe-5459-4892-b962-b09b1528a0ea tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Request method failure captured: Jun 07 14:22:48.360730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: DELETE /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c HTTP/1.1 Jun 07 14:22:48.360730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:22:48.360730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:22:48.360730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:22:48.360730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:22:48.360730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:22:48.360730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:22:48.360730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:22:48.360730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:22:48.360730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin17fqHNGjQulX3wNXiHSGKban-HcuZjEmlzpovq7Lprk7Vq0CwzKO8hqHDgTsHxrhTR_5iA7JccFf6tiPqaYd95kRaHBM9CWvpyksUJlF48VnZ3cv3W-CNSQI7PLcV_Nq4swlKXnP3XqCYSQ1gu09FgyvYxHaUj6gF5TiY9kK25V4XU Jun 07 14:22:48.360730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:22:48.360730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:22:48.360730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:22:48.360730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:22:48.360730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:22:48.360730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:22:48.360730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: 5da54606acd24962be630e28ff636d72 Jun 07 14:22:48.360730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-DeleteServersTestJSON-1287933540 Jun 07 14:22:48.360730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:22:48.360730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:22:48.361887 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5da54606acd24962be630e28ff636d72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5da54606acd24962be630e28ff636d72", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5da54606acd24962be630e28ff636d72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5da54606acd24962be630e28ff636d72"}]}] Jun 07 14:22:48.361887 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-DeleteServersTestJSON-1287933540 Jun 07 14:22:48.361887 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: 5da54606acd24962be630e28ff636d72 Jun 07 14:22:48.361887 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-DeleteServersTestJSON-1287933540 Jun 07 14:22:48.361887 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-DeleteServersTestJSON-1287933540-project Jun 07 14:22:48.361887 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:22:48.361887 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:22:48.361887 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: 936db0436820496ebf8cc741852dda10 Jun 07 14:22:48.361887 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-DeleteServersTestJSON-1287933540-project Jun 07 14:22:48.361887 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:22:48.361887 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance 09792bed-de41-489d-8ab2-6a1bc9ac884c could not be found. Jun 07 14:22:48.361887 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': '09792bed-de41-489d-8ab2-6a1bc9ac884c'} Jun 07 14:22:48.362537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:22:48.362537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:22:48.362537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:22:48.362537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:22:48.362537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:22:48.362537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:22:48.362537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:22:48.362537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:22:48.362537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:22:48.362537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:22:48.362537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09792bed-de41-489d-8ab2-6a1bc9ac884c could not be found. Jun 07 14:22:48.362537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:22:48.362537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:22:48.362537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:22:48.362537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:22:48.362537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:22:48.362537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:22:48.362537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:22:48.362537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:22:48.362537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:22:48.363620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:22:48.363620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 14:22:48.363620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 14:22:48.363620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 14:22:48.363620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 14:22:48.363620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:22:48.363620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:22:48.363620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:22:48.363620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:22:48.363620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09792bed-de41-489d-8ab2-6a1bc9ac884c could not be found. Jun 07 14:22:48.363620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:22:48.363620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:22:48.363620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:22:48.363620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:22:48.363620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:22:48.363620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:22:48.363620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:22:48.363620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:22:48.363620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09792bed-de41-489d-8ab2-6a1bc9ac884c could not be found. Jun 07 14:22:48.363620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:22:48.364698 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-bbfb10fe-5459-4892-b962-b09b1528a0ea tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Returning 404 to user: Instance 09792bed-de41-489d-8ab2-6a1bc9ac884c could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:22:48.364698 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-bbfb10fe-5459-4892-b962-b09b1528a0ea tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "DELETE /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 404 len: 111 microversion: 2.1 time: 0.058433 Jun 07 14:22:48.364698 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 102/198] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:22:48 2022] DELETE /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:22:48.371441 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e85eacad-f3e2-43d9-95e9-9fe0ec1f779d tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:48.373233 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e85eacad-f3e2-43d9-95e9-9fe0ec1f779d tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] [instance: 09792bed-de41-489d-8ab2-6a1bc9ac884c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:48.387769 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e85eacad-f3e2-43d9-95e9-9fe0ec1f779d tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:48.388582 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e85eacad-f3e2-43d9-95e9-9fe0ec1f779d tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:48.389442 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e85eacad-f3e2-43d9-95e9-9fe0ec1f779d tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:48.390096 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e85eacad-f3e2-43d9-95e9-9fe0ec1f779d tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:48.406888 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-e85eacad-f3e2-43d9-95e9-9fe0ec1f779d tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] HTTP exception thrown: Instance 09792bed-de41-489d-8ab2-6a1bc9ac884c could not be found. Jun 07 14:22:48.412213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e85eacad-f3e2-43d9-95e9-9fe0ec1f779d tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Request method failure captured: Jun 07 14:22:48.412213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c HTTP/1.1 Jun 07 14:22:48.412213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 07 14:22:48.412213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 07 14:22:48.412213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Connection: close Jun 07 14:22:48.412213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 07 14:22:48.412213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 07 14:22:48.412213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Host: 10.222.0.81 Jun 07 14:22:48.412213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 07 14:22:48.412213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 07 14:22:48.412213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABin17fqHNGjQulX3wNXiHSGKban-HcuZjEmlzpovq7Lprk7Vq0CwzKO8hqHDgTsHxrhTR_5iA7JccFf6tiPqaYd95kRaHBM9CWvpyksUJlF48VnZ3cv3W-CNSQI7PLcV_Nq4swlKXnP3XqCYSQ1gu09FgyvYxHaUj6gF5TiY9kK25V4XU Jun 07 14:22:48.412213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 07 14:22:48.412213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 07 14:22:48.412213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 07 14:22:48.412213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 07 14:22:48.412213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 07 14:22:48.412213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 07 14:22:48.412213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Id: 5da54606acd24962be630e28ff636d72 Jun 07 14:22:48.412213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-DeleteServersTestJSON-1287933540 Jun 07 14:22:48.412213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Role: member,reader Jun 07 14:22:48.412213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Roles: member,reader Jun 07 14:22:48.413519 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5da54606acd24962be630e28ff636d72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5da54606acd24962be630e28ff636d72", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5da54606acd24962be630e28ff636d72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5da54606acd24962be630e28ff636d72"}]}] Jun 07 14:22:48.413519 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-DeleteServersTestJSON-1287933540 Jun 07 14:22:48.413519 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 5da54606acd24962be630e28ff636d72 Jun 07 14:22:48.413519 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-DeleteServersTestJSON-1287933540 Jun 07 14:22:48.413519 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User: tempest-DeleteServersTestJSON-1287933540-project Jun 07 14:22:48.413519 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 07 14:22:48.413519 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 07 14:22:48.413519 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Id: 936db0436820496ebf8cc741852dda10 Jun 07 14:22:48.413519 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-DeleteServersTestJSON-1287933540-project Jun 07 14:22:48.413519 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: method: > Jun 07 14:22:48.413519 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: exception: Instance 09792bed-de41-489d-8ab2-6a1bc9ac884c could not be found. Jun 07 14:22:48.413519 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: action_args: {'id': '09792bed-de41-489d-8ab2-6a1bc9ac884c'} Jun 07 14:22:48.414235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:22:48.414235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:22:48.414235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:22:48.414235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:22:48.414235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:22:48.414235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:22:48.414235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:22:48.414235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:22:48.414235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:22:48.414235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:22:48.414235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09792bed-de41-489d-8ab2-6a1bc9ac884c could not be found. Jun 07 14:22:48.414235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:22:48.414235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:22:48.414235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:22:48.414235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:22:48.414235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:22:48.414235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:22:48.414235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:22:48.414235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:22:48.414235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:22:48.415393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:22:48.415393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:22:48.415393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:22:48.415393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:22:48.415393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:22:48.415393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:22:48.415393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:22:48.415393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09792bed-de41-489d-8ab2-6a1bc9ac884c could not be found. Jun 07 14:22:48.415393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:22:48.415393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:22:48.415393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:22:48.415393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:22:48.415393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:22:48.415393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:22:48.415393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:22:48.415393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:22:48.415393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09792bed-de41-489d-8ab2-6a1bc9ac884c could not be found. Jun 07 14:22:48.415393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:22:48.418273 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e85eacad-f3e2-43d9-95e9-9fe0ec1f779d tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] Returning 404 to user: Instance 09792bed-de41-489d-8ab2-6a1bc9ac884c could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:22:48.418273 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e85eacad-f3e2-43d9-95e9-9fe0ec1f779d tempest-DeleteServersTestJSON-1287933540 tempest-DeleteServersTestJSON-1287933540-project] 10.222.0.81 "GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c" status: 404 len: 111 microversion: 2.1 time: 0.046918 Jun 07 14:22:48.418273 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 97/199] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:48 2022] GET /compute/v2.1/servers/09792bed-de41-489d-8ab2-6a1bc9ac884c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 14:22:49.177766 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-9cb8e1ec-caf0-4280-a6ec-233602969214 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:49.178471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-9cb8e1ec-caf0-4280-a6ec-233602969214 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:49.185642 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9cb8e1ec-caf0-4280-a6ec-233602969214 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:49.186095 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9cb8e1ec-caf0-4280-a6ec-233602969214 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:49.186876 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9cb8e1ec-caf0-4280-a6ec-233602969214 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:49.187535 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9cb8e1ec-caf0-4280-a6ec-233602969214 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:49.428430 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-9cb8e1ec-caf0-4280-a6ec-233602969214 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:49.443043 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-9cb8e1ec-caf0-4280-a6ec-233602969214 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.274754 Jun 07 14:22:49.444555 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 103/200] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:49 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:50.461647 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c6c5bd4d-808b-44fe-86da-b61a0d2f31b7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:50.462336 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c6c5bd4d-808b-44fe-86da-b61a0d2f31b7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:50.466314 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:50.472231 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c6c5bd4d-808b-44fe-86da-b61a0d2f31b7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:50.472996 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c6c5bd4d-808b-44fe-86da-b61a0d2f31b7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:50.473928 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c6c5bd4d-808b-44fe-86da-b61a0d2f31b7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:50.474902 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c6c5bd4d-808b-44fe-86da-b61a0d2f31b7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:50.644927 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c6c5bd4d-808b-44fe-86da-b61a0d2f31b7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:50.657810 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c6c5bd4d-808b-44fe-86da-b61a0d2f31b7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.200275 Jun 07 14:22:50.667881 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 98/201] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:50 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:51.675093 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-1a75d338-f22a-47ab-b215-a96aff42487e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:51.675967 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-1a75d338-f22a-47ab-b215-a96aff42487e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:51.678263 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=54 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:51.683920 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1a75d338-f22a-47ab-b215-a96aff42487e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:51.684936 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1a75d338-f22a-47ab-b215-a96aff42487e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:51.686268 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1a75d338-f22a-47ab-b215-a96aff42487e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:51.687107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1a75d338-f22a-47ab-b215-a96aff42487e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:51.850073 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-1a75d338-f22a-47ab-b215-a96aff42487e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:51.859148 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-1a75d338-f22a-47ab-b215-a96aff42487e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.187886 Jun 07 14:22:51.859756 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 104/202] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:51 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:52.877998 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-caf795d7-a8e7-4ee1-ac28-6d5e933fd8a1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:52.878615 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-caf795d7-a8e7-4ee1-ac28-6d5e933fd8a1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:52.884849 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-caf795d7-a8e7-4ee1-ac28-6d5e933fd8a1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:52.885302 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-caf795d7-a8e7-4ee1-ac28-6d5e933fd8a1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:52.886234 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-caf795d7-a8e7-4ee1-ac28-6d5e933fd8a1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:52.886833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-caf795d7-a8e7-4ee1-ac28-6d5e933fd8a1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:53.093472 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-caf795d7-a8e7-4ee1-ac28-6d5e933fd8a1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:53.107501 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-caf795d7-a8e7-4ee1-ac28-6d5e933fd8a1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.231978 Jun 07 14:22:53.109016 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 99/203] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:52 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:54.139039 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-782a112f-a45d-4a95-903b-26b7569be8c7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:54.139697 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-782a112f-a45d-4a95-903b-26b7569be8c7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:54.146561 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-782a112f-a45d-4a95-903b-26b7569be8c7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:54.147180 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-782a112f-a45d-4a95-903b-26b7569be8c7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:54.148068 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-782a112f-a45d-4a95-903b-26b7569be8c7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:54.148553 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-782a112f-a45d-4a95-903b-26b7569be8c7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:54.344489 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-782a112f-a45d-4a95-903b-26b7569be8c7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:54.355585 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-782a112f-a45d-4a95-903b-26b7569be8c7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.221137 Jun 07 14:22:54.357090 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 105/204] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:54 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:55.373367 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-dbea1159-29fd-4689-8f46-a7e11a9ba8eb tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:55.373978 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-dbea1159-29fd-4689-8f46-a7e11a9ba8eb tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:55.380490 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dbea1159-29fd-4689-8f46-a7e11a9ba8eb tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:55.380935 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dbea1159-29fd-4689-8f46-a7e11a9ba8eb tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:55.381699 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dbea1159-29fd-4689-8f46-a7e11a9ba8eb tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:55.382130 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dbea1159-29fd-4689-8f46-a7e11a9ba8eb tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:55.511532 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-dbea1159-29fd-4689-8f46-a7e11a9ba8eb tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:55.520030 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-dbea1159-29fd-4689-8f46-a7e11a9ba8eb tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.151181 Jun 07 14:22:55.520601 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 100/205] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:55 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:56.536894 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-49b37611-906b-4692-bfb0-47f7e4a751ec tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:56.537642 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-49b37611-906b-4692-bfb0-47f7e4a751ec tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:56.544090 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-49b37611-906b-4692-bfb0-47f7e4a751ec tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:56.544969 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-49b37611-906b-4692-bfb0-47f7e4a751ec tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:56.546012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-49b37611-906b-4692-bfb0-47f7e4a751ec tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:56.546523 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-49b37611-906b-4692-bfb0-47f7e4a751ec tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:56.761859 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-49b37611-906b-4692-bfb0-47f7e4a751ec tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:56.774557 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-49b37611-906b-4692-bfb0-47f7e4a751ec tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.241333 Jun 07 14:22:56.776569 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 106/206] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:56 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:57.792486 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-625dd22a-56d1-4220-9f81-d2d5513f50e9 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:57.793103 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-625dd22a-56d1-4220-9f81-d2d5513f50e9 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:57.800591 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-625dd22a-56d1-4220-9f81-d2d5513f50e9 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:57.801048 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-625dd22a-56d1-4220-9f81-d2d5513f50e9 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:57.801818 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-625dd22a-56d1-4220-9f81-d2d5513f50e9 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:57.802250 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-625dd22a-56d1-4220-9f81-d2d5513f50e9 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:57.942528 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-625dd22a-56d1-4220-9f81-d2d5513f50e9 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:57.950437 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-625dd22a-56d1-4220-9f81-d2d5513f50e9 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.161458 Jun 07 14:22:57.950994 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 101/207] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:57 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:22:58.966850 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-024e4d66-c97f-4b5b-b19a-9b663d70a6fc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:22:58.967487 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-024e4d66-c97f-4b5b-b19a-9b663d70a6fc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:22:58.973518 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-024e4d66-c97f-4b5b-b19a-9b663d70a6fc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:58.974219 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-024e4d66-c97f-4b5b-b19a-9b663d70a6fc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:58.975001 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-024e4d66-c97f-4b5b-b19a-9b663d70a6fc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:22:58.975445 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-024e4d66-c97f-4b5b-b19a-9b663d70a6fc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:22:59.100641 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-024e4d66-c97f-4b5b-b19a-9b663d70a6fc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:22:59.108733 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-024e4d66-c97f-4b5b-b19a-9b663d70a6fc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.145722 Jun 07 14:22:59.109297 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 107/208] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:22:58 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:00.125409 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-fea1a657-ac0c-4d26-a162-a49d638c6164 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:00.126019 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-fea1a657-ac0c-4d26-a162-a49d638c6164 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:00.132608 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fea1a657-ac0c-4d26-a162-a49d638c6164 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:00.133000 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fea1a657-ac0c-4d26-a162-a49d638c6164 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:00.133792 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fea1a657-ac0c-4d26-a162-a49d638c6164 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:00.134227 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fea1a657-ac0c-4d26-a162-a49d638c6164 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:00.263914 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-fea1a657-ac0c-4d26-a162-a49d638c6164 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:00.271405 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-fea1a657-ac0c-4d26-a162-a49d638c6164 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.149919 Jun 07 14:23:00.271973 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 102/209] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:00 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:01.288566 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3a491ce0-8410-4c60-9ae7-b919d8a27167 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:01.289175 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-3a491ce0-8410-4c60-9ae7-b919d8a27167 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:01.295832 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3a491ce0-8410-4c60-9ae7-b919d8a27167 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:01.296276 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3a491ce0-8410-4c60-9ae7-b919d8a27167 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:01.297022 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3a491ce0-8410-4c60-9ae7-b919d8a27167 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:01.297450 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3a491ce0-8410-4c60-9ae7-b919d8a27167 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:01.425145 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-3a491ce0-8410-4c60-9ae7-b919d8a27167 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:01.432477 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-3a491ce0-8410-4c60-9ae7-b919d8a27167 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.147749 Jun 07 14:23:01.433040 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 108/210] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:01 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:02.449365 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f52354eb-9b1d-432f-9b68-9d78b8ef79bb tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:02.450582 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f52354eb-9b1d-432f-9b68-9d78b8ef79bb tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:02.457113 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f52354eb-9b1d-432f-9b68-9d78b8ef79bb tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:02.457563 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f52354eb-9b1d-432f-9b68-9d78b8ef79bb tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:02.458340 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f52354eb-9b1d-432f-9b68-9d78b8ef79bb tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:02.458756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f52354eb-9b1d-432f-9b68-9d78b8ef79bb tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:02.596524 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f52354eb-9b1d-432f-9b68-9d78b8ef79bb tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:02.605306 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f52354eb-9b1d-432f-9b68-9d78b8ef79bb tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.159990 Jun 07 14:23:02.607026 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 103/211] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:02 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:03.624524 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-b58d96eb-1b5a-4bd2-963c-ddfee45164ce tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:03.625138 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-b58d96eb-1b5a-4bd2-963c-ddfee45164ce tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:03.631149 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b58d96eb-1b5a-4bd2-963c-ddfee45164ce tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:03.631627 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b58d96eb-1b5a-4bd2-963c-ddfee45164ce tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:03.632379 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b58d96eb-1b5a-4bd2-963c-ddfee45164ce tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:03.632838 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b58d96eb-1b5a-4bd2-963c-ddfee45164ce tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:03.765665 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-b58d96eb-1b5a-4bd2-963c-ddfee45164ce tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:03.767978 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=100 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:03.774389 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-b58d96eb-1b5a-4bd2-963c-ddfee45164ce tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.154549 Jun 07 14:23:03.774959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 109/212] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:03 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:04.790351 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b283cd7f-7349-474d-b28c-9d86f413be11 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:04.790969 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b283cd7f-7349-474d-b28c-9d86f413be11 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:04.798126 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b283cd7f-7349-474d-b28c-9d86f413be11 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:04.798577 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b283cd7f-7349-474d-b28c-9d86f413be11 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:04.799368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b283cd7f-7349-474d-b28c-9d86f413be11 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:04.799810 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b283cd7f-7349-474d-b28c-9d86f413be11 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:04.928541 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b283cd7f-7349-474d-b28c-9d86f413be11 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:04.936638 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b283cd7f-7349-474d-b28c-9d86f413be11 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.150098 Jun 07 14:23:04.937423 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 104/213] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:04 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:05.953837 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-efe6423d-6147-4c6a-9bdf-0a798b10e11c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:05.954564 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-efe6423d-6147-4c6a-9bdf-0a798b10e11c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:05.960832 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-efe6423d-6147-4c6a-9bdf-0a798b10e11c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:05.963954 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-efe6423d-6147-4c6a-9bdf-0a798b10e11c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:05.965424 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-efe6423d-6147-4c6a-9bdf-0a798b10e11c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:05.965972 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-efe6423d-6147-4c6a-9bdf-0a798b10e11c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:06.132599 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-efe6423d-6147-4c6a-9bdf-0a798b10e11c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:06.148221 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-efe6423d-6147-4c6a-9bdf-0a798b10e11c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.192392 Jun 07 14:23:06.148221 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 110/214] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:05 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:23:07.171846 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3ea99486-6fb6-4aba-b456-21a87496a2db tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:07.173123 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3ea99486-6fb6-4aba-b456-21a87496a2db tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:07.180664 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3ea99486-6fb6-4aba-b456-21a87496a2db tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:07.181609 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3ea99486-6fb6-4aba-b456-21a87496a2db tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:07.182496 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3ea99486-6fb6-4aba-b456-21a87496a2db tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:07.183041 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3ea99486-6fb6-4aba-b456-21a87496a2db tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:07.401405 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3ea99486-6fb6-4aba-b456-21a87496a2db tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:07.410723 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3ea99486-6fb6-4aba-b456-21a87496a2db tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.249962 Jun 07 14:23:07.411905 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 105/215] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:07 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:08.432438 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-34c97e9c-5cd0-4f69-92a6-16a57225aaba tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:08.432438 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-34c97e9c-5cd0-4f69-92a6-16a57225aaba tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:08.437612 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-34c97e9c-5cd0-4f69-92a6-16a57225aaba tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:08.438444 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-34c97e9c-5cd0-4f69-92a6-16a57225aaba tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:08.439266 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-34c97e9c-5cd0-4f69-92a6-16a57225aaba tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:08.439983 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-34c97e9c-5cd0-4f69-92a6-16a57225aaba tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:08.637068 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-34c97e9c-5cd0-4f69-92a6-16a57225aaba tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:08.645792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-34c97e9c-5cd0-4f69-92a6-16a57225aaba tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.222480 Jun 07 14:23:08.646609 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 111/216] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:08 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:09.663350 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-de4955c1-3420-4ef2-b289-e78ebb6d2bea tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:09.664701 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-de4955c1-3420-4ef2-b289-e78ebb6d2bea tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:09.672778 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-de4955c1-3420-4ef2-b289-e78ebb6d2bea tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:09.673616 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-de4955c1-3420-4ef2-b289-e78ebb6d2bea tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:09.674617 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-de4955c1-3420-4ef2-b289-e78ebb6d2bea tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:09.675584 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-de4955c1-3420-4ef2-b289-e78ebb6d2bea tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:09.931957 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-de4955c1-3420-4ef2-b289-e78ebb6d2bea tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:09.941360 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-de4955c1-3420-4ef2-b289-e78ebb6d2bea tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.281707 Jun 07 14:23:09.951697 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 106/217] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:09 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:10.957766 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3ea0d155-94bc-4730-ae5b-c2c605ec6004 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:10.958387 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-3ea0d155-94bc-4730-ae5b-c2c605ec6004 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:10.968252 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3ea0d155-94bc-4730-ae5b-c2c605ec6004 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:10.971628 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3ea0d155-94bc-4730-ae5b-c2c605ec6004 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:10.972584 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3ea0d155-94bc-4730-ae5b-c2c605ec6004 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:10.973542 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3ea0d155-94bc-4730-ae5b-c2c605ec6004 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:11.420653 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-3ea0d155-94bc-4730-ae5b-c2c605ec6004 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:11.435992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-3ea0d155-94bc-4730-ae5b-c2c605ec6004 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.480219 Jun 07 14:23:11.437865 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 112/218] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:10 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:23:12.455124 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e1681871-c58c-4874-b1de-55dcf51fc1d6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:12.456332 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e1681871-c58c-4874-b1de-55dcf51fc1d6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:12.476308 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e1681871-c58c-4874-b1de-55dcf51fc1d6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:12.477582 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e1681871-c58c-4874-b1de-55dcf51fc1d6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:12.478611 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e1681871-c58c-4874-b1de-55dcf51fc1d6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:12.479050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e1681871-c58c-4874-b1de-55dcf51fc1d6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:12.636296 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e1681871-c58c-4874-b1de-55dcf51fc1d6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:12.645903 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e1681871-c58c-4874-b1de-55dcf51fc1d6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.195752 Jun 07 14:23:12.646491 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 107/219] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:12 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:13.664711 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-20c44479-c531-43ca-bb3e-d9d51f2e5f1a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:13.665732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-20c44479-c531-43ca-bb3e-d9d51f2e5f1a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:13.673890 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-20c44479-c531-43ca-bb3e-d9d51f2e5f1a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:13.674387 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-20c44479-c531-43ca-bb3e-d9d51f2e5f1a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:13.675245 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-20c44479-c531-43ca-bb3e-d9d51f2e5f1a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:13.675880 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-20c44479-c531-43ca-bb3e-d9d51f2e5f1a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:13.808911 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-20c44479-c531-43ca-bb3e-d9d51f2e5f1a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:13.816346 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-20c44479-c531-43ca-bb3e-d9d51f2e5f1a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.156293 Jun 07 14:23:13.816918 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 113/220] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:13 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:14.834071 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3c808826-fd1d-451a-a0fe-c545c161699a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:14.834686 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3c808826-fd1d-451a-a0fe-c545c161699a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:14.842292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3c808826-fd1d-451a-a0fe-c545c161699a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:14.842832 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3c808826-fd1d-451a-a0fe-c545c161699a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:14.843658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3c808826-fd1d-451a-a0fe-c545c161699a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:14.844166 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3c808826-fd1d-451a-a0fe-c545c161699a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:14.848314 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=85 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:14.975004 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3c808826-fd1d-451a-a0fe-c545c161699a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:14.982695 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3c808826-fd1d-451a-a0fe-c545c161699a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.152643 Jun 07 14:23:14.983367 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 108/221] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:14 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:15.514456 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3ef3a521-6d12-4c11-a0d4-433b69a08762 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-528490830", "imageRef": "2864004b-970a-480b-8453-14794f9ccca2", "flavorRef": "452", "networks": [{"uuid": "852d511c-cad0-48ac-b18c-ff9209889a76"}]}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:23:15.572943 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.network.neutron [None req-3ef3a521-6d12-4c11-a0d4-433b69a08762 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] validate_networks() for [('852d511c-cad0-48ac-b18c-ff9209889a76', None, None, None, None, None)] {{(pid=117565) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:23:15.977253 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-3ef3a521-6d12-4c11-a0d4-433b69a08762 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Flavor limits 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:23:15.978093 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-3ef3a521-6d12-4c11-a0d4-433b69a08762 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Image limits 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:23:15.978669 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-3ef3a521-6d12-4c11-a0d4-433b69a08762 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Flavor pref 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:23:15.979201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-3ef3a521-6d12-4c11-a0d4-433b69a08762 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Image pref 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:23:15.979767 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-3ef3a521-6d12-4c11-a0d4-433b69a08762 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:23:15.990324 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3ef3a521-6d12-4c11-a0d4-433b69a08762 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:15.990965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3ef3a521-6d12-4c11-a0d4-433b69a08762 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:15.992152 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3ef3a521-6d12-4c11-a0d4-433b69a08762 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:15.992692 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3ef3a521-6d12-4c11-a0d4-433b69a08762 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:16.002928 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c5cedfcf-cd8a-488f-85a7-cf5e075af31f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:16.010819 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c5cedfcf-cd8a-488f-85a7-cf5e075af31f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:16.030842 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c5cedfcf-cd8a-488f-85a7-cf5e075af31f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:16.031649 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c5cedfcf-cd8a-488f-85a7-cf5e075af31f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:16.032919 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c5cedfcf-cd8a-488f-85a7-cf5e075af31f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:16.033660 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c5cedfcf-cd8a-488f-85a7-cf5e075af31f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:16.062129 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-3ef3a521-6d12-4c11-a0d4-433b69a08762 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Getting quotas for project ecb2b7cbdaf9495480fc881e823c1913. Resources: {'ram', 'cores', 'instances'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:23:16.072692 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-3ef3a521-6d12-4c11-a0d4-433b69a08762 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Getting quotas for user becdcd1df4a641e6a5bda05220f7aa07 and project ecb2b7cbdaf9495480fc881e823c1913. Resources: {'ram', 'cores', 'instances'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:23:16.088421 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-3ef3a521-6d12-4c11-a0d4-433b69a08762 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Going to run 1 instances... {{(pid=117565) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:23:16.092186 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-3ef3a521-6d12-4c11-a0d4-433b69a08762 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2864004b-970a-480b-8453-14794f9ccca2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:23:16.150745 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-3ef3a521-6d12-4c11-a0d4-433b69a08762 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641284 Jun 07 14:23:16.160574 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 114/222] 10.222.0.81 () {60 vars in 1146 bytes} [Tue Jun 7 14:23:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:23:16.165895 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-36a2212b-b719-4fca-afb5-a88b0fd9d605 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:16.166717 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-36a2212b-b719-4fca-afb5-a88b0fd9d605 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:16.268519 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-36a2212b-b719-4fca-afb5-a88b0fd9d605 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:16.276426 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-36a2212b-b719-4fca-afb5-a88b0fd9d605 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1213 microversion: 2.1 time: 0.114531 Jun 07 14:23:16.277110 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 115/223] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:16 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1213 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:16.336578 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c5cedfcf-cd8a-488f-85a7-cf5e075af31f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:16.346406 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c5cedfcf-cd8a-488f-85a7-cf5e075af31f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.349867 Jun 07 14:23:16.347161 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 109/224] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:15 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:17.294335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-45b14dd1-6da4-4a99-8950-85549ab3e5c7 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:17.294983 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-45b14dd1-6da4-4a99-8950-85549ab3e5c7 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:17.300977 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-45b14dd1-6da4-4a99-8950-85549ab3e5c7 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:17.301426 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-45b14dd1-6da4-4a99-8950-85549ab3e5c7 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:17.302178 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-45b14dd1-6da4-4a99-8950-85549ab3e5c7 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:17.302608 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-45b14dd1-6da4-4a99-8950-85549ab3e5c7 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:17.362259 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-45b14dd1-6da4-4a99-8950-85549ab3e5c7 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:17.364069 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7ba71238-e086-4112-8549-9b64bb203914 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:17.364687 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7ba71238-e086-4112-8549-9b64bb203914 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:17.369530 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-45b14dd1-6da4-4a99-8950-85549ab3e5c7 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1217 microversion: 2.1 time: 0.079596 Jun 07 14:23:17.370097 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 116/225] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:17 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:17.371564 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7ba71238-e086-4112-8549-9b64bb203914 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:17.372010 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7ba71238-e086-4112-8549-9b64bb203914 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:17.372779 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7ba71238-e086-4112-8549-9b64bb203914 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:17.373218 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7ba71238-e086-4112-8549-9b64bb203914 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:17.505049 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-7ba71238-e086-4112-8549-9b64bb203914 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:17.513131 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7ba71238-e086-4112-8549-9b64bb203914 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.152948 Jun 07 14:23:17.513705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 110/226] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:17 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:23:18.388101 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-abe6f70c-24e2-4b49-acbc-35b1cdb4345c tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:18.388653 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-abe6f70c-24e2-4b49-acbc-35b1cdb4345c tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:18.394651 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-abe6f70c-24e2-4b49-acbc-35b1cdb4345c tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:18.395100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-abe6f70c-24e2-4b49-acbc-35b1cdb4345c tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:18.395895 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-abe6f70c-24e2-4b49-acbc-35b1cdb4345c tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:18.396330 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-abe6f70c-24e2-4b49-acbc-35b1cdb4345c tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:18.455238 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-abe6f70c-24e2-4b49-acbc-35b1cdb4345c tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:18.462529 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-abe6f70c-24e2-4b49-acbc-35b1cdb4345c tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1217 microversion: 2.1 time: 0.078914 Jun 07 14:23:18.463098 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 117/227] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:18 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:18.530934 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0da044e1-6bbe-48ce-93c8-0c2cc6e38622 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:18.531571 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0da044e1-6bbe-48ce-93c8-0c2cc6e38622 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:18.537952 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0da044e1-6bbe-48ce-93c8-0c2cc6e38622 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:18.538407 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0da044e1-6bbe-48ce-93c8-0c2cc6e38622 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:18.539159 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0da044e1-6bbe-48ce-93c8-0c2cc6e38622 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:18.539612 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0da044e1-6bbe-48ce-93c8-0c2cc6e38622 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:18.667954 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0da044e1-6bbe-48ce-93c8-0c2cc6e38622 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:18.675506 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0da044e1-6bbe-48ce-93c8-0c2cc6e38622 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1519 microversion: 2.1 time: 0.149556 Jun 07 14:23:18.676077 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 111/228] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:18 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:19.480194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-70acfd60-25f5-41ec-b461-6a8bd862d1f6 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:19.480818 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-70acfd60-25f5-41ec-b461-6a8bd862d1f6 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:19.486730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-70acfd60-25f5-41ec-b461-6a8bd862d1f6 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:19.487178 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-70acfd60-25f5-41ec-b461-6a8bd862d1f6 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:19.487964 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-70acfd60-25f5-41ec-b461-6a8bd862d1f6 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:19.488398 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-70acfd60-25f5-41ec-b461-6a8bd862d1f6 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:19.578156 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-70acfd60-25f5-41ec-b461-6a8bd862d1f6 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:19.586060 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-70acfd60-25f5-41ec-b461-6a8bd862d1f6 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1217 microversion: 2.1 time: 0.109681 Jun 07 14:23:19.587105 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 118/229] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:19 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1217 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:19.692867 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-37ea7b6e-a00d-4f51-8f50-46e8950e3b8a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:19.693466 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-37ea7b6e-a00d-4f51-8f50-46e8950e3b8a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:19.700589 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-37ea7b6e-a00d-4f51-8f50-46e8950e3b8a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:19.701042 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-37ea7b6e-a00d-4f51-8f50-46e8950e3b8a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:19.701840 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-37ea7b6e-a00d-4f51-8f50-46e8950e3b8a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:19.702326 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-37ea7b6e-a00d-4f51-8f50-46e8950e3b8a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:19.831242 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-37ea7b6e-a00d-4f51-8f50-46e8950e3b8a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:19.839407 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-37ea7b6e-a00d-4f51-8f50-46e8950e3b8a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1499 microversion: 2.1 time: 0.150368 Jun 07 14:23:19.851284 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 112/230] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:19 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1499 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:19.857291 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-c4f54dc2-1d4c-4af5-948e-55223217ac30 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:19.857868 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-c4f54dc2-1d4c-4af5-948e-55223217ac30 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:19.865855 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c4f54dc2-1d4c-4af5-948e-55223217ac30 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:19.866306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c4f54dc2-1d4c-4af5-948e-55223217ac30 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:19.867110 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c4f54dc2-1d4c-4af5-948e-55223217ac30 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:19.867769 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c4f54dc2-1d4c-4af5-948e-55223217ac30 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:20.017300 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-c4f54dc2-1d4c-4af5-948e-55223217ac30 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:20.025281 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-c4f54dc2-1d4c-4af5-948e-55223217ac30 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1515 microversion: 2.1 time: 0.173030 Jun 07 14:23:20.025858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 119/231] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:19 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:20.606680 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-869dd96f-68f8-47d5-ad24-3234244d3686 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:20.606680 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-869dd96f-68f8-47d5-ad24-3234244d3686 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:20.608488 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=30 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:20.613601 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-869dd96f-68f8-47d5-ad24-3234244d3686 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:20.614046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-869dd96f-68f8-47d5-ad24-3234244d3686 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:20.614802 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-869dd96f-68f8-47d5-ad24-3234244d3686 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:20.615267 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-869dd96f-68f8-47d5-ad24-3234244d3686 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:20.682311 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-869dd96f-68f8-47d5-ad24-3234244d3686 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:20.690547 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-869dd96f-68f8-47d5-ad24-3234244d3686 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1265 microversion: 2.1 time: 0.089094 Jun 07 14:23:20.691120 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 113/232] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:20 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:21.461676 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-b35ab72c-bc6a-469d-adce-f538e5ade63a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:23:21.464013 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-b35ab72c-bc6a-469d-adce-f538e5ade63a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:21.476360 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b35ab72c-bc6a-469d-adce-f538e5ade63a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:21.478196 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b35ab72c-bc6a-469d-adce-f538e5ade63a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:21.479281 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b35ab72c-bc6a-469d-adce-f538e5ade63a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:21.482957 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b35ab72c-bc6a-469d-adce-f538e5ade63a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:21.522599 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.objects.instance [None req-b35ab72c-bc6a-469d-adce-f538e5ade63a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lazy-loading 'flavor' on Instance uuid 4dd5700e-2891-4b99-ba1f-d5304a5c8f58 {{(pid=117565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:23:21.672317 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-b35ab72c-bc6a-469d-adce-f538e5ade63a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "POST /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58/action" status: 200 len: 32 microversion: 2.1 time: 0.214423 Jun 07 14:23:21.676763 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 120/233] 10.222.0.81 () {60 vars in 1277 bytes} [Tue Jun 7 14:23:21 2022] POST /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58/action => generated 32 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 14:23:21.682154 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-87c45e4e-fc56-4d64-a0fc-49384dcfa943 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:21.683494 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-87c45e4e-fc56-4d64-a0fc-49384dcfa943 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:21.698559 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-87c45e4e-fc56-4d64-a0fc-49384dcfa943 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:21.701493 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-87c45e4e-fc56-4d64-a0fc-49384dcfa943 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:21.702337 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-87c45e4e-fc56-4d64-a0fc-49384dcfa943 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:21.703694 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-87c45e4e-fc56-4d64-a0fc-49384dcfa943 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:21.720576 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-c41c69f7-7920-429e-867d-332d4b59ea8e tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:21.724809 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-c41c69f7-7920-429e-867d-332d4b59ea8e tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:21.729357 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:21.739685 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c41c69f7-7920-429e-867d-332d4b59ea8e tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:21.741142 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c41c69f7-7920-429e-867d-332d4b59ea8e tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:21.742107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c41c69f7-7920-429e-867d-332d4b59ea8e tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:21.744660 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c41c69f7-7920-429e-867d-332d4b59ea8e tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:22.085942 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-87c45e4e-fc56-4d64-a0fc-49384dcfa943 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:22.090817 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-c41c69f7-7920-429e-867d-332d4b59ea8e tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:22.095994 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-87c45e4e-fc56-4d64-a0fc-49384dcfa943 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.417674 Jun 07 14:23:22.107434 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 114/234] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:21 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:22.108904 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-c41c69f7-7920-429e-867d-332d4b59ea8e tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1313 microversion: 2.1 time: 0.404399 Jun 07 14:23:22.109493 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 121/235] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:21 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:23.114231 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-25174c97-961b-46c8-a123-46c10d37cb66 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:23.115607 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-25174c97-961b-46c8-a123-46c10d37cb66 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:23.124469 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-70c8bc66-6a94-4fda-960a-d4ea2b29997f req-d5fc8a02-e275-40ac-8f2e-1e9be0b5ac14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48a95090-dd7c-4e27-92ee-e11af90f53e4", "tag": "5c2c2efc-9804-47c8-a532-6ec318470a6d"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:23:23.131653 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-25174c97-961b-46c8-a123-46c10d37cb66 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:23.135028 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-70c8bc66-6a94-4fda-960a-d4ea2b29997f req-d5fc8a02-e275-40ac-8f2e-1e9be0b5ac14 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:23.136373 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-70c8bc66-6a94-4fda-960a-d4ea2b29997f req-d5fc8a02-e275-40ac-8f2e-1e9be0b5ac14 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:23.138199 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-25174c97-961b-46c8-a123-46c10d37cb66 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:23.139044 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-25174c97-961b-46c8-a123-46c10d37cb66 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:23.139517 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-25174c97-961b-46c8-a123-46c10d37cb66 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:23.176063 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-70c8bc66-6a94-4fda-960a-d4ea2b29997f req-d5fc8a02-e275-40ac-8f2e-1e9be0b5ac14 service nova] Creating event network-changed:5c2c2efc-9804-47c8-a532-6ec318470a6d for instance 48a95090-dd7c-4e27-92ee-e11af90f53e4 on hv-cinder-83608 Jun 07 14:23:23.186484 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-70c8bc66-6a94-4fda-960a-d4ea2b29997f req-d5fc8a02-e275-40ac-8f2e-1e9be0b5ac14 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068167 Jun 07 14:23:23.187265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 122/236] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:23:23.194141 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-85922879-f80d-4bab-8387-9c32af43ee41 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:23.195681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-85922879-f80d-4bab-8387-9c32af43ee41 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:23.205526 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-85922879-f80d-4bab-8387-9c32af43ee41 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:23.206202 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-85922879-f80d-4bab-8387-9c32af43ee41 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:23.208105 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-85922879-f80d-4bab-8387-9c32af43ee41 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:23.208984 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-85922879-f80d-4bab-8387-9c32af43ee41 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:23.720032 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-85922879-f80d-4bab-8387-9c32af43ee41 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:23.746607 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-85922879-f80d-4bab-8387-9c32af43ee41 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1313 microversion: 2.1 time: 0.557331 Jun 07 14:23:23.748324 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 123/237] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:23 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1313 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:23.807197 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-25174c97-961b-46c8-a123-46c10d37cb66 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:23.823020 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-25174c97-961b-46c8-a123-46c10d37cb66 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.712975 Jun 07 14:23:23.823826 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 115/238] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:23 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:24.768380 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-5cb2566a-a9a7-433c-ad9c-32950aa31e36 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:24.769133 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-5cb2566a-a9a7-433c-ad9c-32950aa31e36 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:24.775909 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5cb2566a-a9a7-433c-ad9c-32950aa31e36 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:24.777147 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5cb2566a-a9a7-433c-ad9c-32950aa31e36 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:24.778426 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5cb2566a-a9a7-433c-ad9c-32950aa31e36 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:24.779001 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5cb2566a-a9a7-433c-ad9c-32950aa31e36 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:24.844770 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-94afc8dd-a1a9-40af-92c2-aafb757c2aab tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:24.845395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-94afc8dd-a1a9-40af-92c2-aafb757c2aab tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:24.862181 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-94afc8dd-a1a9-40af-92c2-aafb757c2aab tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:24.862645 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-94afc8dd-a1a9-40af-92c2-aafb757c2aab tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:24.863464 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-94afc8dd-a1a9-40af-92c2-aafb757c2aab tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:24.864066 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-94afc8dd-a1a9-40af-92c2-aafb757c2aab tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:25.022675 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-5cb2566a-a9a7-433c-ad9c-32950aa31e36 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:25.034957 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-5cb2566a-a9a7-433c-ad9c-32950aa31e36 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1313 microversion: 2.1 time: 0.270670 Jun 07 14:23:25.035694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 124/239] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:24 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:25.065185 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-94afc8dd-a1a9-40af-92c2-aafb757c2aab tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:25.076178 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-94afc8dd-a1a9-40af-92c2-aafb757c2aab tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.235101 Jun 07 14:23:25.077332 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 116/240] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:24 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:26.053626 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-f384959b-4cca-4842-9188-758b1103dce4 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:26.054381 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-f384959b-4cca-4842-9188-758b1103dce4 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:26.062414 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=2 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:26.064950 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f384959b-4cca-4842-9188-758b1103dce4 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:26.065532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f384959b-4cca-4842-9188-758b1103dce4 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:26.066335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f384959b-4cca-4842-9188-758b1103dce4 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:26.066778 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f384959b-4cca-4842-9188-758b1103dce4 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:26.093087 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d46da19c-6932-4836-828d-9ded23e0a448 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:26.094440 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d46da19c-6932-4836-828d-9ded23e0a448 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:26.108596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d46da19c-6932-4836-828d-9ded23e0a448 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:26.109044 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d46da19c-6932-4836-828d-9ded23e0a448 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:26.110045 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d46da19c-6932-4836-828d-9ded23e0a448 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:26.110641 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d46da19c-6932-4836-828d-9ded23e0a448 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:26.272862 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=8 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:26.338408 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-f384959b-4cca-4842-9188-758b1103dce4 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:26.342590 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-d46da19c-6932-4836-828d-9ded23e0a448 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:26.363139 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-f384959b-4cca-4842-9188-758b1103dce4 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1313 microversion: 2.1 time: 0.314014 Jun 07 14:23:26.365223 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d46da19c-6932-4836-828d-9ded23e0a448 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.276564 Jun 07 14:23:26.365979 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 125/241] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:26 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:23:26.379070 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 117/242] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:26 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:27.391288 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-59d17caa-4672-4241-9379-aa30272e1e1e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:27.392801 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-b7780f46-bb53-4f36-ad04-e96334fb9462 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:27.394742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-b7780f46-bb53-4f36-ad04-e96334fb9462 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:27.396277 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-59d17caa-4672-4241-9379-aa30272e1e1e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:27.407763 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-59d17caa-4672-4241-9379-aa30272e1e1e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:27.408215 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-59d17caa-4672-4241-9379-aa30272e1e1e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:27.409035 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-59d17caa-4672-4241-9379-aa30272e1e1e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:27.409476 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-59d17caa-4672-4241-9379-aa30272e1e1e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:27.412285 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b7780f46-bb53-4f36-ad04-e96334fb9462 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:27.412742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b7780f46-bb53-4f36-ad04-e96334fb9462 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:27.413646 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b7780f46-bb53-4f36-ad04-e96334fb9462 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:27.414082 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b7780f46-bb53-4f36-ad04-e96334fb9462 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:27.701446 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-59d17caa-4672-4241-9379-aa30272e1e1e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:27.706635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-b7780f46-bb53-4f36-ad04-e96334fb9462 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:27.709868 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:27.712026 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-59d17caa-4672-4241-9379-aa30272e1e1e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.331612 Jun 07 14:23:27.712626 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 118/243] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:27 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:27.725797 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-b7780f46-bb53-4f36-ad04-e96334fb9462 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1313 microversion: 2.1 time: 0.346206 Jun 07 14:23:27.726791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 126/244] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:27 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:28.733301 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a0763ed1-6a8c-4646-85c6-bdf651c94011 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:28.733915 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a0763ed1-6a8c-4646-85c6-bdf651c94011 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:28.748157 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-576a4c85-922e-4d2e-b91f-33e355adb313 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:28.749506 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-576a4c85-922e-4d2e-b91f-33e355adb313 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:28.758036 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a0763ed1-6a8c-4646-85c6-bdf651c94011 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:28.759516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a0763ed1-6a8c-4646-85c6-bdf651c94011 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:28.760336 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-576a4c85-922e-4d2e-b91f-33e355adb313 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:28.762044 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-576a4c85-922e-4d2e-b91f-33e355adb313 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:28.762707 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a0763ed1-6a8c-4646-85c6-bdf651c94011 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:28.763798 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a0763ed1-6a8c-4646-85c6-bdf651c94011 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:28.764470 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-576a4c85-922e-4d2e-b91f-33e355adb313 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:28.770499 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-576a4c85-922e-4d2e-b91f-33e355adb313 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:29.096554 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a0763ed1-6a8c-4646-85c6-bdf651c94011 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:29.105499 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a0763ed1-6a8c-4646-85c6-bdf651c94011 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.378115 Jun 07 14:23:29.106252 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 119/245] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:28 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:29.129134 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-576a4c85-922e-4d2e-b91f-33e355adb313 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:29.136750 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-576a4c85-922e-4d2e-b91f-33e355adb313 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1313 microversion: 2.1 time: 0.394478 Jun 07 14:23:29.137469 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 127/246] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:28 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:30.123709 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2ef74ca7-c722-4dc7-9d2b-9673d708913f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:30.124856 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2ef74ca7-c722-4dc7-9d2b-9673d708913f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:30.132382 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2ef74ca7-c722-4dc7-9d2b-9673d708913f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:30.133348 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2ef74ca7-c722-4dc7-9d2b-9673d708913f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:30.134462 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2ef74ca7-c722-4dc7-9d2b-9673d708913f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:30.135062 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2ef74ca7-c722-4dc7-9d2b-9673d708913f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:30.153285 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-740da394-abb7-4592-89cd-a21ce172c92c tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:30.170424 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-740da394-abb7-4592-89cd-a21ce172c92c tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:30.179481 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-740da394-abb7-4592-89cd-a21ce172c92c tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:30.179935 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-740da394-abb7-4592-89cd-a21ce172c92c tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:30.183889 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-740da394-abb7-4592-89cd-a21ce172c92c tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:30.184583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-740da394-abb7-4592-89cd-a21ce172c92c tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:30.487515 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2ef74ca7-c722-4dc7-9d2b-9673d708913f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:30.491044 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-740da394-abb7-4592-89cd-a21ce172c92c tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:30.497573 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2ef74ca7-c722-4dc7-9d2b-9673d708913f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.379362 Jun 07 14:23:30.503393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 120/247] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:30 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:30.512494 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-740da394-abb7-4592-89cd-a21ce172c92c tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1313 microversion: 2.1 time: 0.363329 Jun 07 14:23:30.513084 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 128/248] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:30 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:23:31.496082 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b97e17ed-e429-4675-a1bd-43d7eecfa5bc tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:31.497329 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b97e17ed-e429-4675-a1bd-43d7eecfa5bc tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:31.506467 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b97e17ed-e429-4675-a1bd-43d7eecfa5bc tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:31.507255 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b97e17ed-e429-4675-a1bd-43d7eecfa5bc tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:31.508488 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b97e17ed-e429-4675-a1bd-43d7eecfa5bc tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:31.508937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b97e17ed-e429-4675-a1bd-43d7eecfa5bc tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:31.514860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-78f5001f-d8c8-4640-988d-1ea407760417 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:31.515506 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-78f5001f-d8c8-4640-988d-1ea407760417 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:31.526140 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-78f5001f-d8c8-4640-988d-1ea407760417 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:31.527271 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-78f5001f-d8c8-4640-988d-1ea407760417 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:31.530708 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-78f5001f-d8c8-4640-988d-1ea407760417 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:31.530708 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-78f5001f-d8c8-4640-988d-1ea407760417 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:31.547695 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b97e17ed-e429-4675-a1bd-43d7eecfa5bc tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b/ips" status: 200 len: 144 microversion: 2.1 time: 0.057678 Jun 07 14:23:31.554812 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 121/249] 10.222.0.81 () {58 vars in 1247 bytes} [Tue Jun 7 14:23:31 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b/ips => generated 144 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:23:31.560791 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d29cd3e1-00c3-4978-9631-da1db329403d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:31.561399 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d29cd3e1-00c3-4978-9631-da1db329403d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:31.569732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d29cd3e1-00c3-4978-9631-da1db329403d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:31.570439 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d29cd3e1-00c3-4978-9631-da1db329403d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:31.571572 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d29cd3e1-00c3-4978-9631-da1db329403d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:31.572392 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d29cd3e1-00c3-4978-9631-da1db329403d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:31.821967 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-78f5001f-d8c8-4640-988d-1ea407760417 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:31.832637 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-d29cd3e1-00c3-4978-9631-da1db329403d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:31.833394 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-78f5001f-d8c8-4640-988d-1ea407760417 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.322564 Jun 07 14:23:31.833995 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 129/250] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:31 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:31.844266 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d29cd3e1-00c3-4978-9631-da1db329403d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1313 microversion: 2.1 time: 0.287748 Jun 07 14:23:31.845528 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 122/251] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:31 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:32.852227 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-92a67901-b6f9-45f6-a0a5-fdac30749ed4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:32.852964 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-92a67901-b6f9-45f6-a0a5-fdac30749ed4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:32.861095 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-92a67901-b6f9-45f6-a0a5-fdac30749ed4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:32.862651 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6bc6e927-f88b-47b6-ba73-262c98c144fe tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:32.863301 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-6bc6e927-f88b-47b6-ba73-262c98c144fe tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:32.867737 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-92a67901-b6f9-45f6-a0a5-fdac30749ed4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:32.868640 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-92a67901-b6f9-45f6-a0a5-fdac30749ed4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:32.869160 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-92a67901-b6f9-45f6-a0a5-fdac30749ed4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:32.875689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6bc6e927-f88b-47b6-ba73-262c98c144fe tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:32.876521 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6bc6e927-f88b-47b6-ba73-262c98c144fe tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:32.878922 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6bc6e927-f88b-47b6-ba73-262c98c144fe tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:32.882150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6bc6e927-f88b-47b6-ba73-262c98c144fe tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:33.174257 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-92a67901-b6f9-45f6-a0a5-fdac30749ed4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:33.186142 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-92a67901-b6f9-45f6-a0a5-fdac30749ed4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.338255 Jun 07 14:23:33.196610 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 130/252] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:32 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:33.203771 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-691e3374-f25f-42b4-a5c0-cb4db8f2b521 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1087891582", "imageRef": "2864004b-970a-480b-8453-14794f9ccca2", "flavorRef": "452", "networks": [{"uuid": "74e54650-a65d-4ca7-9de2-261f4002b6e6"}]}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:23:33.228789 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-6bc6e927-f88b-47b6-ba73-262c98c144fe tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:33.244674 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6bc6e927-f88b-47b6-ba73-262c98c144fe tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1313 microversion: 2.1 time: 0.385890 Jun 07 14:23:33.246159 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 123/253] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:32 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:33.277763 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.network.neutron [None req-691e3374-f25f-42b4-a5c0-cb4db8f2b521 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] validate_networks() for [('74e54650-a65d-4ca7-9de2-261f4002b6e6', None, None, None, None, None)] {{(pid=117565) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:23:33.723827 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-691e3374-f25f-42b4-a5c0-cb4db8f2b521 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Flavor limits 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:23:33.724248 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-691e3374-f25f-42b4-a5c0-cb4db8f2b521 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Image limits 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:23:33.724808 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-691e3374-f25f-42b4-a5c0-cb4db8f2b521 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Flavor pref 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:23:33.725207 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-691e3374-f25f-42b4-a5c0-cb4db8f2b521 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Image pref 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:23:33.725909 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-691e3374-f25f-42b4-a5c0-cb4db8f2b521 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:23:33.767303 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-691e3374-f25f-42b4-a5c0-cb4db8f2b521 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:33.767749 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-691e3374-f25f-42b4-a5c0-cb4db8f2b521 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:33.768535 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-691e3374-f25f-42b4-a5c0-cb4db8f2b521 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:33.770143 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-691e3374-f25f-42b4-a5c0-cb4db8f2b521 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:33.796838 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-691e3374-f25f-42b4-a5c0-cb4db8f2b521 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Getting quotas for project 59f9adafa99949b3b5f624c6ae7be57e. Resources: {'ram', 'cores', 'instances'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:23:33.803597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-691e3374-f25f-42b4-a5c0-cb4db8f2b521 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Getting quotas for user 79357bc4bc0d4b8d9dd5b07a25510f3a and project 59f9adafa99949b3b5f624c6ae7be57e. Resources: {'ram', 'cores', 'instances'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:23:33.820926 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-691e3374-f25f-42b4-a5c0-cb4db8f2b521 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Going to run 1 instances... {{(pid=117565) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:23:33.825662 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-691e3374-f25f-42b4-a5c0-cb4db8f2b521 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2864004b-970a-480b-8453-14794f9ccca2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:23:33.935317 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-691e3374-f25f-42b4-a5c0-cb4db8f2b521 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.736922 Jun 07 14:23:33.935981 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 131/254] 10.222.0.81 () {60 vars in 1146 bytes} [Tue Jun 7 14:23:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:23:33.947141 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8ad365db-96f2-4953-a94d-e539c140aba9 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:33.949349 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8ad365db-96f2-4953-a94d-e539c140aba9 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:34.037197 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8ad365db-96f2-4953-a94d-e539c140aba9 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:34.049854 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8ad365db-96f2-4953-a94d-e539c140aba9 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c" status: 200 len: 1219 microversion: 2.1 time: 0.106342 Jun 07 14:23:34.060960 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 124/255] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:33 2022] GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:34.205372 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-73f058e4-d654-4d70-a408-30e11d4e57b8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:34.206384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-73f058e4-d654-4d70-a408-30e11d4e57b8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:34.223858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-73f058e4-d654-4d70-a408-30e11d4e57b8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:34.224231 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-73f058e4-d654-4d70-a408-30e11d4e57b8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:34.225171 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-73f058e4-d654-4d70-a408-30e11d4e57b8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:34.225432 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-73f058e4-d654-4d70-a408-30e11d4e57b8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:34.268534 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9aeea148-cc7c-45e8-ad6e-c79aed42d188 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:34.270406 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9aeea148-cc7c-45e8-ad6e-c79aed42d188 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:34.288228 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9aeea148-cc7c-45e8-ad6e-c79aed42d188 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:34.290206 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9aeea148-cc7c-45e8-ad6e-c79aed42d188 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:34.297365 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9aeea148-cc7c-45e8-ad6e-c79aed42d188 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:34.299714 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9aeea148-cc7c-45e8-ad6e-c79aed42d188 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:34.761574 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-73f058e4-d654-4d70-a408-30e11d4e57b8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:34.775165 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-73f058e4-d654-4d70-a408-30e11d4e57b8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.573892 Jun 07 14:23:34.776861 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 132/256] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:34 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:34.813745 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9aeea148-cc7c-45e8-ad6e-c79aed42d188 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:34.824795 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9aeea148-cc7c-45e8-ad6e-c79aed42d188 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1313 microversion: 2.1 time: 0.566162 Jun 07 14:23:34.826132 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 125/257] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:34 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1313 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:35.068257 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-5fe8312e-9c12-41ad-8bc7-eb9a2792b690 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:35.069014 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-5fe8312e-9c12-41ad-8bc7-eb9a2792b690 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:35.085470 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5fe8312e-9c12-41ad-8bc7-eb9a2792b690 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:35.086044 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5fe8312e-9c12-41ad-8bc7-eb9a2792b690 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:35.088413 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5fe8312e-9c12-41ad-8bc7-eb9a2792b690 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:35.090677 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5fe8312e-9c12-41ad-8bc7-eb9a2792b690 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:35.289923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-5fe8312e-9c12-41ad-8bc7-eb9a2792b690 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:35.309953 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-5fe8312e-9c12-41ad-8bc7-eb9a2792b690 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c" status: 200 len: 1215 microversion: 2.1 time: 0.246636 Jun 07 14:23:35.312694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 133/258] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:35 2022] GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c => generated 1215 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:35.817523 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-56d47e3b-6c39-47db-9716-383958fa4305 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:35.818805 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-56d47e3b-6c39-47db-9716-383958fa4305 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:35.827470 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-56d47e3b-6c39-47db-9716-383958fa4305 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:35.828317 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-56d47e3b-6c39-47db-9716-383958fa4305 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:35.829391 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-56d47e3b-6c39-47db-9716-383958fa4305 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:35.830049 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-56d47e3b-6c39-47db-9716-383958fa4305 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:35.839897 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=100 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:35.844864 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-8677a601-83a0-4abe-a506-d9d7bef6acfd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:35.846831 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-8677a601-83a0-4abe-a506-d9d7bef6acfd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:35.888778 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8677a601-83a0-4abe-a506-d9d7bef6acfd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:35.892886 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8677a601-83a0-4abe-a506-d9d7bef6acfd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:35.895468 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8677a601-83a0-4abe-a506-d9d7bef6acfd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:35.899194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8677a601-83a0-4abe-a506-d9d7bef6acfd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:36.886544 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-56d47e3b-6c39-47db-9716-383958fa4305 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:36.904850 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-56d47e3b-6c39-47db-9716-383958fa4305 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 1.113583 Jun 07 14:23:36.909285 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 126/259] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:35 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:36.926026 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-bd199385-5424-4860-a70f-2fe8d095dabc tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:36.932508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-bd199385-5424-4860-a70f-2fe8d095dabc tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:36.968361 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bd199385-5424-4860-a70f-2fe8d095dabc tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:36.969033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bd199385-5424-4860-a70f-2fe8d095dabc tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:36.974466 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bd199385-5424-4860-a70f-2fe8d095dabc tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:36.975154 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bd199385-5424-4860-a70f-2fe8d095dabc tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:37.100227 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8677a601-83a0-4abe-a506-d9d7bef6acfd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:37.115513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-8677a601-83a0-4abe-a506-d9d7bef6acfd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1313 microversion: 2.1 time: 1.276825 Jun 07 14:23:37.118250 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 134/260] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:35 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1313 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:37.148642 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-bd199385-5424-4860-a70f-2fe8d095dabc tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:37.182947 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-bd199385-5424-4860-a70f-2fe8d095dabc tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c" status: 200 len: 1277 microversion: 2.1 time: 0.270939 Jun 07 14:23:37.183769 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 127/261] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:36 2022] GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c => generated 1277 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:37.930907 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-cf82c191-5f74-4401-8f90-27aebeee648e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:37.931947 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-cf82c191-5f74-4401-8f90-27aebeee648e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:37.944905 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cf82c191-5f74-4401-8f90-27aebeee648e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:37.945616 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cf82c191-5f74-4401-8f90-27aebeee648e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:37.952470 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cf82c191-5f74-4401-8f90-27aebeee648e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:37.953503 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cf82c191-5f74-4401-8f90-27aebeee648e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:38.101222 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-52258aa0-7d6f-41ea-8424-152755c6c232 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d20e704a-3621-4d68-a585-2f24a3ae9588"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:23:38.102371 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-52258aa0-7d6f-41ea-8424-152755c6c232 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:38.110810 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-52258aa0-7d6f-41ea-8424-152755c6c232 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:38.111293 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-52258aa0-7d6f-41ea-8424-152755c6c232 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:38.112143 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-52258aa0-7d6f-41ea-8424-152755c6c232 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:38.112579 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-52258aa0-7d6f-41ea-8424-152755c6c232 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:38.329322 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-cf82c191-5f74-4401-8f90-27aebeee648e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:38.349139 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-cf82c191-5f74-4401-8f90-27aebeee648e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.418329 Jun 07 14:23:38.351076 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 135/262] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:37 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:38.362170 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-a4fd09aa-629e-4bcf-99dd-b7229109e00f tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:38.363119 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-a4fd09aa-629e-4bcf-99dd-b7229109e00f tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:38.385444 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a4fd09aa-629e-4bcf-99dd-b7229109e00f tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:38.388142 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a4fd09aa-629e-4bcf-99dd-b7229109e00f tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:38.390056 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a4fd09aa-629e-4bcf-99dd-b7229109e00f tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:38.391573 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a4fd09aa-629e-4bcf-99dd-b7229109e00f tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:38.506943 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-52258aa0-7d6f-41ea-8424-152755c6c232 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "POST /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.409443 Jun 07 14:23:38.508424 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 128/263] 10.222.0.81 () {60 vars in 1322 bytes} [Tue Jun 7 14:23:38 2022] POST /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b/os-volume_attachments => generated 194 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:23:38.531066 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f4c63821-1f89-49c9-a055-014bea694aa3 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:38.532116 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f4c63821-1f89-49c9-a055-014bea694aa3 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:38.543769 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f4c63821-1f89-49c9-a055-014bea694aa3 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:38.544332 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f4c63821-1f89-49c9-a055-014bea694aa3 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:38.545328 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f4c63821-1f89-49c9-a055-014bea694aa3 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:38.545925 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f4c63821-1f89-49c9-a055-014bea694aa3 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:39.050097 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-a4fd09aa-629e-4bcf-99dd-b7229109e00f tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:39.059706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-a4fd09aa-629e-4bcf-99dd-b7229109e00f tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1313 microversion: 2.1 time: 0.707080 Jun 07 14:23:39.061124 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 136/264] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:38 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1313 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:39.075716 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f4c63821-1f89-49c9-a055-014bea694aa3 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:39.084294 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f4c63821-1f89-49c9-a055-014bea694aa3 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c" status: 200 len: 1319 microversion: 2.1 time: 0.574230 Jun 07 14:23:39.085024 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 129/265] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:38 2022] GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c => generated 1319 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:39.338840 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-32b8b1b0-609f-4400-b425-bb3a338e0f22 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Action: 'create', calling method: .version_select at 0x7ff37f7a79d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1960209199", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/HmmeyHK29FCf32TT9dTKOpdzp5qa/J1GoYFfa3vt8zetXdwiObP/zyhsz73IQWtP/wqkGLdZdG+E7tBxsTGOeh6ldbJT9npoQzfppM7zKhSMZ5aE4nRlrnJQ77ZjmEA=="}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:23:39.365882 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-32b8b1b0-609f-4400-b425-bb3a338e0f22 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Getting quotas for project b5977f5c113f44eebed133afa6238c2e. Resources: {'key_pairs'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:23:39.368220 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3e26f986-0730-4a56-bb6c-084774a9f82a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:39.369031 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3e26f986-0730-4a56-bb6c-084774a9f82a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:39.373658 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-32b8b1b0-609f-4400-b425-bb3a338e0f22 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Getting quotas for user 86a6598d0d7c41faae54d48ea8a850d7 and project b5977f5c113f44eebed133afa6238c2e. Resources: {'key_pairs'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:23:39.388444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3e26f986-0730-4a56-bb6c-084774a9f82a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:39.388833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3e26f986-0730-4a56-bb6c-084774a9f82a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:39.390394 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3e26f986-0730-4a56-bb6c-084774a9f82a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:39.390847 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3e26f986-0730-4a56-bb6c-084774a9f82a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:39.428798 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-32b8b1b0-609f-4400-b425-bb3a338e0f22 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.365956 Jun 07 14:23:39.430322 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 137/266] 10.222.0.81 () {60 vars in 1158 bytes} [Tue Jun 7 14:23:39 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:23:39.684204 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-adec0f24-3467-4349-9d75-c70bb64cbde4 req-b74f31ca-9591-4e0d-b6bd-5a0cfbdebb00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48a95090-dd7c-4e27-92ee-e11af90f53e4", "name": "network-vif-plugged", "status": "completed", "tag": "5c2c2efc-9804-47c8-a532-6ec318470a6d"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:23:39.693722 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-adec0f24-3467-4349-9d75-c70bb64cbde4 req-b74f31ca-9591-4e0d-b6bd-5a0cfbdebb00 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:39.694760 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-adec0f24-3467-4349-9d75-c70bb64cbde4 req-b74f31ca-9591-4e0d-b6bd-5a0cfbdebb00 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:39.703935 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3e26f986-0730-4a56-bb6c-084774a9f82a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:39.716218 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3e26f986-0730-4a56-bb6c-084774a9f82a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.352835 Jun 07 14:23:39.716822 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 130/267] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:39 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:23:39.723903 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-adec0f24-3467-4349-9d75-c70bb64cbde4 req-b74f31ca-9591-4e0d-b6bd-5a0cfbdebb00 service nova] Creating event network-vif-plugged:5c2c2efc-9804-47c8-a532-6ec318470a6d for instance 48a95090-dd7c-4e27-92ee-e11af90f53e4 on hv-cinder-83608 Jun 07 14:23:39.738140 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-adec0f24-3467-4349-9d75-c70bb64cbde4 req-b74f31ca-9591-4e0d-b6bd-5a0cfbdebb00 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058044 Jun 07 14:23:39.738854 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 138/268] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:23:39.757206 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-e3d6fa93-caa1-40e4-a4c9-282b34fe83b6 req-b8061296-debc-4bd8-af53-f840e49d6135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dc684fd-368e-45b1-b487-b39a2552b70c", "tag": "52d793d5-4bb0-44e5-9e83-b03db851e80b"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:23:39.767268 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-e3d6fa93-caa1-40e4-a4c9-282b34fe83b6 req-b8061296-debc-4bd8-af53-f840e49d6135 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:39.768095 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-e3d6fa93-caa1-40e4-a4c9-282b34fe83b6 req-b8061296-debc-4bd8-af53-f840e49d6135 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:39.791178 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-e3d6fa93-caa1-40e4-a4c9-282b34fe83b6 req-b8061296-debc-4bd8-af53-f840e49d6135 service nova] Creating event network-changed:52d793d5-4bb0-44e5-9e83-b03db851e80b for instance 2dc684fd-368e-45b1-b487-b39a2552b70c on hv-cinder-83608 Jun 07 14:23:39.797291 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-e3d6fa93-caa1-40e4-a4c9-282b34fe83b6 req-b8061296-debc-4bd8-af53-f840e49d6135 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044818 Jun 07 14:23:39.798449 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 131/269] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:23:40.079401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-de94925a-f44d-4d92-9f9d-d96fc0de4e5a tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:40.080462 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-de94925a-f44d-4d92-9f9d-d96fc0de4e5a tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:40.087104 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-de94925a-f44d-4d92-9f9d-d96fc0de4e5a tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:40.087834 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-de94925a-f44d-4d92-9f9d-d96fc0de4e5a tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:40.089725 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-de94925a-f44d-4d92-9f9d-d96fc0de4e5a tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:40.090371 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-de94925a-f44d-4d92-9f9d-d96fc0de4e5a tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:40.105540 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-790f32f5-1544-475f-ad54-cd51330a4a9b tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:40.106112 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-790f32f5-1544-475f-ad54-cd51330a4a9b tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:40.112946 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-790f32f5-1544-475f-ad54-cd51330a4a9b tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:40.113622 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-790f32f5-1544-475f-ad54-cd51330a4a9b tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:40.114787 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-790f32f5-1544-475f-ad54-cd51330a4a9b tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:40.115240 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-790f32f5-1544-475f-ad54-cd51330a4a9b tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:40.376670 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-de94925a-f44d-4d92-9f9d-d96fc0de4e5a tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:40.396359 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-de94925a-f44d-4d92-9f9d-d96fc0de4e5a tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1313 microversion: 2.1 time: 0.321877 Jun 07 14:23:40.401684 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 139/270] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:40 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:40.426945 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-790f32f5-1544-475f-ad54-cd51330a4a9b tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:40.442535 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-790f32f5-1544-475f-ad54-cd51330a4a9b tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c" status: 200 len: 1319 microversion: 2.1 time: 0.342719 Jun 07 14:23:40.448961 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 132/271] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:40 2022] GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c => generated 1319 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:23:40.740112 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-af7621fb-0aed-4493-a5a9-037314f47358 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:40.741072 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-af7621fb-0aed-4493-a5a9-037314f47358 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:40.756737 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-af7621fb-0aed-4493-a5a9-037314f47358 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:40.757195 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-af7621fb-0aed-4493-a5a9-037314f47358 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:40.757973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-af7621fb-0aed-4493-a5a9-037314f47358 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:40.763613 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-af7621fb-0aed-4493-a5a9-037314f47358 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:40.960124 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-af7621fb-0aed-4493-a5a9-037314f47358 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:40.968638 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-af7621fb-0aed-4493-a5a9-037314f47358 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.237679 Jun 07 14:23:40.969205 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 140/272] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:40 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:41.413315 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e6cf3208-c275-4939-9b99-b19901309e4b tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:41.413941 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e6cf3208-c275-4939-9b99-b19901309e4b tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:41.425645 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e6cf3208-c275-4939-9b99-b19901309e4b tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:41.425645 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e6cf3208-c275-4939-9b99-b19901309e4b tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:41.425645 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e6cf3208-c275-4939-9b99-b19901309e4b tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:41.426021 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e6cf3208-c275-4939-9b99-b19901309e4b tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:41.465319 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-6e3c0d23-a219-42f1-bbfb-5284fc351b1d tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:41.465941 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-6e3c0d23-a219-42f1-bbfb-5284fc351b1d tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:41.472339 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6e3c0d23-a219-42f1-bbfb-5284fc351b1d tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:41.472793 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6e3c0d23-a219-42f1-bbfb-5284fc351b1d tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:41.473816 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6e3c0d23-a219-42f1-bbfb-5284fc351b1d tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:41.474250 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6e3c0d23-a219-42f1-bbfb-5284fc351b1d tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:41.641844 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e6cf3208-c275-4939-9b99-b19901309e4b tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:41.650693 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e6cf3208-c275-4939-9b99-b19901309e4b tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1313 microversion: 2.1 time: 0.241546 Jun 07 14:23:41.652445 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 133/273] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:41 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:41.673034 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-6e3c0d23-a219-42f1-bbfb-5284fc351b1d tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:41.680731 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-6e3c0d23-a219-42f1-bbfb-5284fc351b1d tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c" status: 200 len: 1319 microversion: 2.1 time: 0.219366 Jun 07 14:23:41.681247 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 141/274] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:41 2022] GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:41.986499 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-fa7c40d9-9aea-41fd-91ca-9dcd39ce993e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:41.987203 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-fa7c40d9-9aea-41fd-91ca-9dcd39ce993e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:41.994169 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fa7c40d9-9aea-41fd-91ca-9dcd39ce993e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:41.994621 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fa7c40d9-9aea-41fd-91ca-9dcd39ce993e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:41.995440 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fa7c40d9-9aea-41fd-91ca-9dcd39ce993e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:41.995884 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fa7c40d9-9aea-41fd-91ca-9dcd39ce993e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:42.129603 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-fa7c40d9-9aea-41fd-91ca-9dcd39ce993e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:42.137462 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-fa7c40d9-9aea-41fd-91ca-9dcd39ce993e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.154840 Jun 07 14:23:42.138043 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 134/275] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:41 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:42.669002 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7041c824-9d1a-49d3-be06-b13dbe87b154 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:42.669628 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-7041c824-9d1a-49d3-be06-b13dbe87b154 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:42.678942 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7041c824-9d1a-49d3-be06-b13dbe87b154 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:42.679663 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7041c824-9d1a-49d3-be06-b13dbe87b154 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:42.680608 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7041c824-9d1a-49d3-be06-b13dbe87b154 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:42.681338 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7041c824-9d1a-49d3-be06-b13dbe87b154 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:42.697761 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9b2a3487-86e6-48f4-a01c-718a1e27eeff tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:42.699010 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9b2a3487-86e6-48f4-a01c-718a1e27eeff tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:42.708639 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9b2a3487-86e6-48f4-a01c-718a1e27eeff tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:42.709371 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9b2a3487-86e6-48f4-a01c-718a1e27eeff tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:42.710905 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9b2a3487-86e6-48f4-a01c-718a1e27eeff tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:42.711571 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9b2a3487-86e6-48f4-a01c-718a1e27eeff tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:42.923992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-7041c824-9d1a-49d3-be06-b13dbe87b154 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:42.931770 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-7041c824-9d1a-49d3-be06-b13dbe87b154 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1313 microversion: 2.1 time: 0.267037 Jun 07 14:23:42.932604 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 142/276] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:42 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:42.937159 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9b2a3487-86e6-48f4-a01c-718a1e27eeff tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:42.945363 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9b2a3487-86e6-48f4-a01c-718a1e27eeff tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c" status: 200 len: 1319 microversion: 2.1 time: 0.251380 Jun 07 14:23:42.945948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 135/277] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:42 2022] GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:23:43.157648 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7718b90b-41a0-46d5-9f75-21dcc98d52b5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:43.157648 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-7718b90b-41a0-46d5-9f75-21dcc98d52b5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:43.161118 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7718b90b-41a0-46d5-9f75-21dcc98d52b5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:43.161632 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7718b90b-41a0-46d5-9f75-21dcc98d52b5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:43.162406 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7718b90b-41a0-46d5-9f75-21dcc98d52b5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:43.163005 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7718b90b-41a0-46d5-9f75-21dcc98d52b5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:43.373341 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-7718b90b-41a0-46d5-9f75-21dcc98d52b5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:43.381200 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-7718b90b-41a0-46d5-9f75-21dcc98d52b5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.231173 Jun 07 14:23:43.381781 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 143/278] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:43 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:43.948534 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1b59bd63-19f8-4a59-9486-7d3ca7031afd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:43.949252 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1b59bd63-19f8-4a59-9486-7d3ca7031afd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:43.955690 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1b59bd63-19f8-4a59-9486-7d3ca7031afd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:43.956147 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1b59bd63-19f8-4a59-9486-7d3ca7031afd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:43.957185 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1b59bd63-19f8-4a59-9486-7d3ca7031afd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:43.957637 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1b59bd63-19f8-4a59-9486-7d3ca7031afd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:43.961673 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-de64423b-c805-442e-982f-707dfae88cb2 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:43.962320 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-de64423b-c805-442e-982f-707dfae88cb2 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:43.964986 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=2 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:43.970499 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-de64423b-c805-442e-982f-707dfae88cb2 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:43.970947 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-de64423b-c805-442e-982f-707dfae88cb2 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:43.971747 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-de64423b-c805-442e-982f-707dfae88cb2 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:43.972182 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-de64423b-c805-442e-982f-707dfae88cb2 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:44.048475 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:44.165567 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1b59bd63-19f8-4a59-9486-7d3ca7031afd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:44.172879 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-de64423b-c805-442e-982f-707dfae88cb2 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:44.176611 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1b59bd63-19f8-4a59-9486-7d3ca7031afd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1313 microversion: 2.1 time: 0.232478 Jun 07 14:23:44.177276 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 136/279] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:43 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:23:44.180132 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-de64423b-c805-442e-982f-707dfae88cb2 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c" status: 200 len: 1319 microversion: 2.1 time: 0.222289 Jun 07 14:23:44.180691 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 144/280] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:43 2022] GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:23:44.397986 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e9daf5e8-bfd4-4585-9884-78d99ec0c721 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:44.398709 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e9daf5e8-bfd4-4585-9884-78d99ec0c721 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:44.405617 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e9daf5e8-bfd4-4585-9884-78d99ec0c721 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:44.406063 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e9daf5e8-bfd4-4585-9884-78d99ec0c721 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:44.406835 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e9daf5e8-bfd4-4585-9884-78d99ec0c721 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:44.407278 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e9daf5e8-bfd4-4585-9884-78d99ec0c721 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:44.543119 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e9daf5e8-bfd4-4585-9884-78d99ec0c721 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:44.550695 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e9daf5e8-bfd4-4585-9884-78d99ec0c721 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.156686 Jun 07 14:23:44.551280 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 137/281] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:44 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:45.194951 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ecd153f5-6004-4a75-a6a2-c9657aa0861a tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:45.195624 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ecd153f5-6004-4a75-a6a2-c9657aa0861a tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:45.198007 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-74e241bb-01dd-47f2-8d68-38379f188651 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:45.199014 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-74e241bb-01dd-47f2-8d68-38379f188651 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:45.202411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ecd153f5-6004-4a75-a6a2-c9657aa0861a tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:45.203059 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ecd153f5-6004-4a75-a6a2-c9657aa0861a tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:45.204033 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ecd153f5-6004-4a75-a6a2-c9657aa0861a tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:45.204624 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ecd153f5-6004-4a75-a6a2-c9657aa0861a tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:45.207084 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-74e241bb-01dd-47f2-8d68-38379f188651 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:45.207654 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-74e241bb-01dd-47f2-8d68-38379f188651 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:45.208483 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-74e241bb-01dd-47f2-8d68-38379f188651 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:45.209076 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-74e241bb-01dd-47f2-8d68-38379f188651 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:45.412168 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ecd153f5-6004-4a75-a6a2-c9657aa0861a tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:45.414397 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=100 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:45.416620 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-74e241bb-01dd-47f2-8d68-38379f188651 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:45.424682 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-74e241bb-01dd-47f2-8d68-38379f188651 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c" status: 200 len: 1319 microversion: 2.1 time: 0.230827 Jun 07 14:23:45.425363 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 138/282] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:45 2022] GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:23:45.430695 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ecd153f5-6004-4a75-a6a2-c9657aa0861a tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1498 microversion: 2.1 time: 0.239899 Jun 07 14:23:45.431300 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 145/283] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:45 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1498 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:45.568246 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c521d68d-30db-4928-a728-b44497da0609 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:45.568996 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c521d68d-30db-4928-a728-b44497da0609 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:45.576555 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c521d68d-30db-4928-a728-b44497da0609 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:45.577264 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c521d68d-30db-4928-a728-b44497da0609 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:45.578128 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c521d68d-30db-4928-a728-b44497da0609 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:45.578641 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c521d68d-30db-4928-a728-b44497da0609 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:45.723096 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c521d68d-30db-4928-a728-b44497da0609 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:45.731604 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c521d68d-30db-4928-a728-b44497da0609 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.167166 Jun 07 14:23:45.732181 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 139/284] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:45 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:46.260815 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-e5cb707f-e6b3-43a1-a8ad-29913ad61a1f tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:46.261424 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-e5cb707f-e6b3-43a1-a8ad-29913ad61a1f tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:46.267492 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e5cb707f-e6b3-43a1-a8ad-29913ad61a1f tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:46.267936 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e5cb707f-e6b3-43a1-a8ad-29913ad61a1f tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:46.268688 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e5cb707f-e6b3-43a1-a8ad-29913ad61a1f tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:46.269125 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e5cb707f-e6b3-43a1-a8ad-29913ad61a1f tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:46.295533 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-e5cb707f-e6b3-43a1-a8ad-29913ad61a1f tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Going to try to terminate instance {{(pid=117565) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:23:46.387382 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-e5cb707f-e6b3-43a1-a8ad-29913ad61a1f tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "DELETE /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 204 len: 0 microversion: 2.1 time: 0.130426 Jun 07 14:23:46.387972 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 146/285] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:23:46 2022] DELETE /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:23:46.396130 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9e7f717c-3f36-468a-b2c1-4ba72b758e1c tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:46.396745 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9e7f717c-3f36-468a-b2c1-4ba72b758e1c tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:46.403514 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9e7f717c-3f36-468a-b2c1-4ba72b758e1c tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:46.403965 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9e7f717c-3f36-468a-b2c1-4ba72b758e1c tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:46.404911 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9e7f717c-3f36-468a-b2c1-4ba72b758e1c tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:46.405353 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9e7f717c-3f36-468a-b2c1-4ba72b758e1c tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:46.445181 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-72047323-2371-4b10-a8e8-d5116544a722 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:46.446218 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-72047323-2371-4b10-a8e8-d5116544a722 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:46.455539 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-72047323-2371-4b10-a8e8-d5116544a722 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:46.456310 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-72047323-2371-4b10-a8e8-d5116544a722 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:46.457273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-72047323-2371-4b10-a8e8-d5116544a722 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:46.458194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-72047323-2371-4b10-a8e8-d5116544a722 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:46.677600 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9e7f717c-3f36-468a-b2c1-4ba72b758e1c tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:46.685335 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9e7f717c-3f36-468a-b2c1-4ba72b758e1c tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1504 microversion: 2.1 time: 0.293095 Jun 07 14:23:46.686463 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 140/286] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:46 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1504 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:46.689617 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-72047323-2371-4b10-a8e8-d5116544a722 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:46.697831 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-72047323-2371-4b10-a8e8-d5116544a722 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c" status: 200 len: 1319 microversion: 2.1 time: 0.257786 Jun 07 14:23:46.699556 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 147/287] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:46 2022] GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:23:46.748155 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a7218f56-0c6c-446b-bbab-77025550b9b1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:46.748771 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a7218f56-0c6c-446b-bbab-77025550b9b1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:46.756225 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a7218f56-0c6c-446b-bbab-77025550b9b1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:46.757004 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a7218f56-0c6c-446b-bbab-77025550b9b1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:46.758172 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a7218f56-0c6c-446b-bbab-77025550b9b1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:46.758739 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a7218f56-0c6c-446b-bbab-77025550b9b1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:46.908459 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a7218f56-0c6c-446b-bbab-77025550b9b1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:46.918491 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a7218f56-0c6c-446b-bbab-77025550b9b1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.174953 Jun 07 14:23:46.919073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 141/288] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:46 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:47.702549 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-c39cb417-64b6-4bb9-a77b-ea76dc2e4459 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:47.703167 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-c39cb417-64b6-4bb9-a77b-ea76dc2e4459 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:47.711545 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c39cb417-64b6-4bb9-a77b-ea76dc2e4459 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:47.711545 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c39cb417-64b6-4bb9-a77b-ea76dc2e4459 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:47.711545 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c39cb417-64b6-4bb9-a77b-ea76dc2e4459 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:47.711545 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c39cb417-64b6-4bb9-a77b-ea76dc2e4459 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:47.716649 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1be3c7cc-3e8d-46f2-afef-7af4062a290b tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:47.717934 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1be3c7cc-3e8d-46f2-afef-7af4062a290b tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:47.724725 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1be3c7cc-3e8d-46f2-afef-7af4062a290b tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:47.725258 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1be3c7cc-3e8d-46f2-afef-7af4062a290b tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:47.726231 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1be3c7cc-3e8d-46f2-afef-7af4062a290b tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:47.726665 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1be3c7cc-3e8d-46f2-afef-7af4062a290b tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:47.731080 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:47.918702 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-c39cb417-64b6-4bb9-a77b-ea76dc2e4459 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:47.927115 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-c39cb417-64b6-4bb9-a77b-ea76dc2e4459 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1504 microversion: 2.1 time: 0.229210 Jun 07 14:23:47.935483 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 148/289] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:47 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:47.935798 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1be3c7cc-3e8d-46f2-afef-7af4062a290b tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:47.941081 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-b6cd10c5-1c5b-4ec0-aa0f-f3c048e5d340 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:47.941619 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1be3c7cc-3e8d-46f2-afef-7af4062a290b tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c" status: 200 len: 1319 microversion: 2.1 time: 0.231230 Jun 07 14:23:47.942036 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-b6cd10c5-1c5b-4ec0-aa0f-f3c048e5d340 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:47.942506 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 142/290] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:47 2022] GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:23:47.949066 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b6cd10c5-1c5b-4ec0-aa0f-f3c048e5d340 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:47.949645 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b6cd10c5-1c5b-4ec0-aa0f-f3c048e5d340 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:47.950499 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b6cd10c5-1c5b-4ec0-aa0f-f3c048e5d340 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:47.951009 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b6cd10c5-1c5b-4ec0-aa0f-f3c048e5d340 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:48.173307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-b6cd10c5-1c5b-4ec0-aa0f-f3c048e5d340 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:48.181296 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-b6cd10c5-1c5b-4ec0-aa0f-f3c048e5d340 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.250178 Jun 07 14:23:48.182553 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 149/291] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:47 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:23:48.273742 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1e8ff099-5aea-445a-ad71-09c233593a23 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:23:48.287754 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1e8ff099-5aea-445a-ad71-09c233593a23 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:48.288218 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1e8ff099-5aea-445a-ad71-09c233593a23 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:48.374538 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1e8ff099-5aea-445a-ad71-09c233593a23 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Going to try to stop instance {{(pid=117564) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 07 14:23:48.437536 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1e8ff099-5aea-445a-ad71-09c233593a23 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "POST /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b/action" status: 202 len: 0 microversion: 2.1 time: 0.167517 Jun 07 14:23:48.456883 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-1a58f15c-1171-4e07-9a06-bcd5fa36d3e9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:48.457763 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-1a58f15c-1171-4e07-9a06-bcd5fa36d3e9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:48.460369 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 143/292] 10.222.0.81 () {60 vars in 1277 bytes} [Tue Jun 7 14:23:48 2022] POST /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:23:48.485111 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1a58f15c-1171-4e07-9a06-bcd5fa36d3e9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:48.487264 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1a58f15c-1171-4e07-9a06-bcd5fa36d3e9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:48.489019 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1a58f15c-1171-4e07-9a06-bcd5fa36d3e9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:48.489465 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1a58f15c-1171-4e07-9a06-bcd5fa36d3e9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:48.674327 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-1a58f15c-1171-4e07-9a06-bcd5fa36d3e9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:48.692147 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-1a58f15c-1171-4e07-9a06-bcd5fa36d3e9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1719 microversion: 2.1 time: 0.247751 Jun 07 14:23:48.693154 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 150/293] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:48 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1719 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:48.915412 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-695cb779-f61a-47bc-94ff-5666a5726b2d req-001ff670-dca7-4417-9aa8-87ac000ed3fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dc684fd-368e-45b1-b487-b39a2552b70c", "name": "network-vif-plugged", "status": "completed", "tag": "52d793d5-4bb0-44e5-9e83-b03db851e80b"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:23:48.927197 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-695cb779-f61a-47bc-94ff-5666a5726b2d req-001ff670-dca7-4417-9aa8-87ac000ed3fb service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:48.928032 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-695cb779-f61a-47bc-94ff-5666a5726b2d req-001ff670-dca7-4417-9aa8-87ac000ed3fb service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:48.947835 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-32464fca-9877-4447-8384-ee2af940a7e3 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:48.949689 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-32464fca-9877-4447-8384-ee2af940a7e3 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:48.956267 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-695cb779-f61a-47bc-94ff-5666a5726b2d req-001ff670-dca7-4417-9aa8-87ac000ed3fb service nova] Creating event network-vif-plugged:52d793d5-4bb0-44e5-9e83-b03db851e80b for instance 2dc684fd-368e-45b1-b487-b39a2552b70c on hv-cinder-83608 Jun 07 14:23:48.958133 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-32464fca-9877-4447-8384-ee2af940a7e3 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:48.958847 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-32464fca-9877-4447-8384-ee2af940a7e3 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:48.960001 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-32464fca-9877-4447-8384-ee2af940a7e3 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:48.960581 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-32464fca-9877-4447-8384-ee2af940a7e3 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:48.970328 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-695cb779-f61a-47bc-94ff-5666a5726b2d req-001ff670-dca7-4417-9aa8-87ac000ed3fb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060283 Jun 07 14:23:48.971924 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 144/294] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:23:48.978509 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d511b93f-4744-4211-8d93-074c553565ff tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:48.981178 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d511b93f-4744-4211-8d93-074c553565ff tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:48.989580 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d511b93f-4744-4211-8d93-074c553565ff tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:48.990563 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d511b93f-4744-4211-8d93-074c553565ff tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:48.991539 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d511b93f-4744-4211-8d93-074c553565ff tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:48.992131 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d511b93f-4744-4211-8d93-074c553565ff tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:49.281297 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-32464fca-9877-4447-8384-ee2af940a7e3 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:49.290576 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-32464fca-9877-4447-8384-ee2af940a7e3 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1504 microversion: 2.1 time: 0.349370 Jun 07 14:23:49.292032 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 151/295] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:48 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1504 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:23:49.296841 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-639c38f8-2203-405d-b0e5-0938f6f8a4ca tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:49.297800 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-639c38f8-2203-405d-b0e5-0938f6f8a4ca tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:49.304175 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-639c38f8-2203-405d-b0e5-0938f6f8a4ca tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:49.304630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-639c38f8-2203-405d-b0e5-0938f6f8a4ca tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:49.305403 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-639c38f8-2203-405d-b0e5-0938f6f8a4ca tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:49.306021 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-639c38f8-2203-405d-b0e5-0938f6f8a4ca tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:49.327983 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-d511b93f-4744-4211-8d93-074c553565ff tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:49.339579 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d511b93f-4744-4211-8d93-074c553565ff tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c" status: 200 len: 1319 microversion: 2.1 time: 0.365902 Jun 07 14:23:49.340290 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 145/296] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:48 2022] GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:49.345243 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-4d64e4da-03ec-47c7-bfb6-3926061175c7 req-c4714965-0021-47be-9967-373d58831ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48a95090-dd7c-4e27-92ee-e11af90f53e4", "name": "network-vif-deleted", "tag": "5c2c2efc-9804-47c8-a532-6ec318470a6d"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:23:49.355668 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-4d64e4da-03ec-47c7-bfb6-3926061175c7 req-c4714965-0021-47be-9967-373d58831ff4 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:49.356398 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-4d64e4da-03ec-47c7-bfb6-3926061175c7 req-c4714965-0021-47be-9967-373d58831ff4 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:49.370073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-4d64e4da-03ec-47c7-bfb6-3926061175c7 req-c4714965-0021-47be-9967-373d58831ff4 service nova] Creating event network-vif-deleted:5c2c2efc-9804-47c8-a532-6ec318470a6d for instance 48a95090-dd7c-4e27-92ee-e11af90f53e4 on hv-cinder-83608 Jun 07 14:23:49.375988 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-4d64e4da-03ec-47c7-bfb6-3926061175c7 req-c4714965-0021-47be-9967-373d58831ff4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034011 Jun 07 14:23:49.377162 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 146/297] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:23:49.386184 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=10 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:49.459883 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-639c38f8-2203-405d-b0e5-0938f6f8a4ca tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:49.468840 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-639c38f8-2203-405d-b0e5-0938f6f8a4ca tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.175551 Jun 07 14:23:49.469980 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 152/298] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:49 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:49.711792 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5cc161b4-03cf-4454-a509-c53e248372f5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:49.712728 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-5cc161b4-03cf-4454-a509-c53e248372f5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:49.721895 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5cc161b4-03cf-4454-a509-c53e248372f5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:49.722522 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5cc161b4-03cf-4454-a509-c53e248372f5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:49.723620 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5cc161b4-03cf-4454-a509-c53e248372f5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:49.724062 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5cc161b4-03cf-4454-a509-c53e248372f5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:49.870995 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5cc161b4-03cf-4454-a509-c53e248372f5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:49.879238 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-5cc161b4-03cf-4454-a509-c53e248372f5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1719 microversion: 2.1 time: 0.171875 Jun 07 14:23:49.879839 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 147/299] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:49 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:50.314199 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-5812948f-c39f-4905-885a-2e7378b788f9 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:50.314761 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-5812948f-c39f-4905-885a-2e7378b788f9 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:50.332230 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5812948f-c39f-4905-885a-2e7378b788f9 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:50.333840 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5812948f-c39f-4905-885a-2e7378b788f9 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:50.336698 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5812948f-c39f-4905-885a-2e7378b788f9 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:50.337330 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5812948f-c39f-4905-885a-2e7378b788f9 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:50.357851 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e7565adf-2c3e-4ced-9b8d-2b0cf1f4360d tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:50.358909 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e7565adf-2c3e-4ced-9b8d-2b0cf1f4360d tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:50.371296 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e7565adf-2c3e-4ced-9b8d-2b0cf1f4360d tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:50.372016 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e7565adf-2c3e-4ced-9b8d-2b0cf1f4360d tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:50.373330 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e7565adf-2c3e-4ced-9b8d-2b0cf1f4360d tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:50.374932 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e7565adf-2c3e-4ced-9b8d-2b0cf1f4360d tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:50.412689 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-5812948f-c39f-4905-885a-2e7378b788f9 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:50.422938 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-5812948f-c39f-4905-885a-2e7378b788f9 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1298 microversion: 2.1 time: 0.118406 Jun 07 14:23:50.423896 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 153/300] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:50 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1298 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:50.488469 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-18189314-5760-4d91-88be-c2b7aff1ee58 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:50.489121 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-18189314-5760-4d91-88be-c2b7aff1ee58 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:50.496400 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-18189314-5760-4d91-88be-c2b7aff1ee58 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:50.496903 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-18189314-5760-4d91-88be-c2b7aff1ee58 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:50.497925 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-18189314-5760-4d91-88be-c2b7aff1ee58 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:50.498493 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-18189314-5760-4d91-88be-c2b7aff1ee58 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:50.586272 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e7565adf-2c3e-4ced-9b8d-2b0cf1f4360d tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:50.595303 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e7565adf-2c3e-4ced-9b8d-2b0cf1f4360d tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c" status: 200 len: 1319 microversion: 2.1 time: 0.242318 Jun 07 14:23:50.596226 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 148/301] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:50 2022] GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:50.654361 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-18189314-5760-4d91-88be-c2b7aff1ee58 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:50.661818 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-18189314-5760-4d91-88be-c2b7aff1ee58 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.177238 Jun 07 14:23:50.662388 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 154/302] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:50 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:50.897139 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5f48989e-db2c-4c6f-a36f-8ceb8f1f6eee tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:50.897758 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-5f48989e-db2c-4c6f-a36f-8ceb8f1f6eee tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:50.900076 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=74 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:50.907707 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5f48989e-db2c-4c6f-a36f-8ceb8f1f6eee tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:50.908414 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5f48989e-db2c-4c6f-a36f-8ceb8f1f6eee tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:50.909270 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5f48989e-db2c-4c6f-a36f-8ceb8f1f6eee tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:50.909743 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5f48989e-db2c-4c6f-a36f-8ceb8f1f6eee tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:51.274552 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5f48989e-db2c-4c6f-a36f-8ceb8f1f6eee tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:51.283346 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-5f48989e-db2c-4c6f-a36f-8ceb8f1f6eee tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1719 microversion: 2.1 time: 0.389989 Jun 07 14:23:51.283912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 149/303] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:50 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1719 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:51.442823 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-018f3e1e-7d9f-4ac3-9944-8abecb0b3260 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:51.444307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-018f3e1e-7d9f-4ac3-9944-8abecb0b3260 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:51.451572 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-018f3e1e-7d9f-4ac3-9944-8abecb0b3260 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:51.452049 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-018f3e1e-7d9f-4ac3-9944-8abecb0b3260 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:51.452808 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-018f3e1e-7d9f-4ac3-9944-8abecb0b3260 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:51.453236 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-018f3e1e-7d9f-4ac3-9944-8abecb0b3260 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:51.517749 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-018f3e1e-7d9f-4ac3-9944-8abecb0b3260 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:51.526450 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-018f3e1e-7d9f-4ac3-9944-8abecb0b3260 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1298 microversion: 2.1 time: 0.087225 Jun 07 14:23:51.527396 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 155/304] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:51 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:51.613303 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ffa445b1-e641-463e-bbf1-45148863d5da tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:51.613912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ffa445b1-e641-463e-bbf1-45148863d5da tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:51.621124 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ffa445b1-e641-463e-bbf1-45148863d5da tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:51.621572 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ffa445b1-e641-463e-bbf1-45148863d5da tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:51.622350 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ffa445b1-e641-463e-bbf1-45148863d5da tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:51.622765 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ffa445b1-e641-463e-bbf1-45148863d5da tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:51.679681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d28c71b4-a7b6-4dcc-a497-505fc2ce6017 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:51.680375 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-d28c71b4-a7b6-4dcc-a497-505fc2ce6017 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:51.682847 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:51.691025 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d28c71b4-a7b6-4dcc-a497-505fc2ce6017 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:51.691581 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d28c71b4-a7b6-4dcc-a497-505fc2ce6017 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:51.692492 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d28c71b4-a7b6-4dcc-a497-505fc2ce6017 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:51.693717 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d28c71b4-a7b6-4dcc-a497-505fc2ce6017 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:51.809758 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ffa445b1-e641-463e-bbf1-45148863d5da tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:51.820252 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ffa445b1-e641-463e-bbf1-45148863d5da tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c" status: 200 len: 1319 microversion: 2.1 time: 0.210637 Jun 07 14:23:51.821174 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 150/305] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:51 2022] GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:51.870631 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-d28c71b4-a7b6-4dcc-a497-505fc2ce6017 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:51.878212 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-d28c71b4-a7b6-4dcc-a497-505fc2ce6017 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.202416 Jun 07 14:23:51.879203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 156/306] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:51 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:23:52.300862 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b00417c2-aa85-4844-92e7-0f455daee1e6 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:52.301519 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b00417c2-aa85-4844-92e7-0f455daee1e6 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:52.307703 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b00417c2-aa85-4844-92e7-0f455daee1e6 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:52.308154 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b00417c2-aa85-4844-92e7-0f455daee1e6 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:52.308928 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b00417c2-aa85-4844-92e7-0f455daee1e6 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:52.309367 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b00417c2-aa85-4844-92e7-0f455daee1e6 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:52.439308 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b00417c2-aa85-4844-92e7-0f455daee1e6 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:52.448071 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b00417c2-aa85-4844-92e7-0f455daee1e6 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1719 microversion: 2.1 time: 0.150527 Jun 07 14:23:52.448760 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 151/307] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:52 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:52.544089 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-12e59be8-46bd-4508-a43f-aef6878e12d6 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:52.544807 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-12e59be8-46bd-4508-a43f-aef6878e12d6 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:52.551119 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-12e59be8-46bd-4508-a43f-aef6878e12d6 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:52.551548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-12e59be8-46bd-4508-a43f-aef6878e12d6 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:52.552310 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-12e59be8-46bd-4508-a43f-aef6878e12d6 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:52.552747 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-12e59be8-46bd-4508-a43f-aef6878e12d6 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:52.585641 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-12e59be8-46bd-4508-a43f-aef6878e12d6 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:52.586089 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-12e59be8-46bd-4508-a43f-aef6878e12d6 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:52.586536 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.objects.instance [None req-12e59be8-46bd-4508-a43f-aef6878e12d6 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lazy-loading 'fault' on Instance uuid 48a95090-dd7c-4e27-92ee-e11af90f53e4 {{(pid=117565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:23:52.632083 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-12e59be8-46bd-4508-a43f-aef6878e12d6 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:52.640391 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-12e59be8-46bd-4508-a43f-aef6878e12d6 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 200 len: 1303 microversion: 2.1 time: 0.100475 Jun 07 14:23:52.640957 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 157/308] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:52 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:52.837888 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c1714628-c5af-4dd3-a938-83d5b8772c20 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:52.839069 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c1714628-c5af-4dd3-a938-83d5b8772c20 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:52.845428 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c1714628-c5af-4dd3-a938-83d5b8772c20 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:52.845889 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c1714628-c5af-4dd3-a938-83d5b8772c20 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:52.846655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c1714628-c5af-4dd3-a938-83d5b8772c20 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:52.847096 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c1714628-c5af-4dd3-a938-83d5b8772c20 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:52.895244 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7325320b-2021-4cb8-afc3-754e927c5986 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:52.895955 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-7325320b-2021-4cb8-afc3-754e927c5986 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:52.906611 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7325320b-2021-4cb8-afc3-754e927c5986 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:52.907057 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7325320b-2021-4cb8-afc3-754e927c5986 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:52.907854 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7325320b-2021-4cb8-afc3-754e927c5986 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:52.908288 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7325320b-2021-4cb8-afc3-754e927c5986 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:53.024269 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c1714628-c5af-4dd3-a938-83d5b8772c20 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:53.037695 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c1714628-c5af-4dd3-a938-83d5b8772c20 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c" status: 200 len: 1319 microversion: 2.1 time: 0.203772 Jun 07 14:23:53.038370 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 152/309] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:52 2022] GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:53.093987 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-7325320b-2021-4cb8-afc3-754e927c5986 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:53.102102 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-7325320b-2021-4cb8-afc3-754e927c5986 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.210630 Jun 07 14:23:53.102672 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 158/310] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:52 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:23:53.466677 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9574614f-2336-416c-8ed1-a117c1e8bac9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:53.467430 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9574614f-2336-416c-8ed1-a117c1e8bac9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:53.473908 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9574614f-2336-416c-8ed1-a117c1e8bac9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:53.474557 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9574614f-2336-416c-8ed1-a117c1e8bac9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:53.475654 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9574614f-2336-416c-8ed1-a117c1e8bac9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:53.476095 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9574614f-2336-416c-8ed1-a117c1e8bac9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:53.630016 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9574614f-2336-416c-8ed1-a117c1e8bac9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:53.641018 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9574614f-2336-416c-8ed1-a117c1e8bac9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1719 microversion: 2.1 time: 0.179045 Jun 07 14:23:53.641609 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 153/311] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:53 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1719 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:53.659906 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-a9437e5a-e178-440b-b7a3-f19a43160a97 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:53.660588 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-a9437e5a-e178-440b-b7a3-f19a43160a97 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: 48a95090-dd7c-4e27-92ee-e11af90f53e4] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:53.667399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a9437e5a-e178-440b-b7a3-f19a43160a97 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:53.667915 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a9437e5a-e178-440b-b7a3-f19a43160a97 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:53.668521 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a9437e5a-e178-440b-b7a3-f19a43160a97 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:53.668981 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a9437e5a-e178-440b-b7a3-f19a43160a97 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:53.689523 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-a9437e5a-e178-440b-b7a3-f19a43160a97 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] HTTP exception thrown: Instance 48a95090-dd7c-4e27-92ee-e11af90f53e4 could not be found. Jun 07 14:23:53.691384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-a9437e5a-e178-440b-b7a3-f19a43160a97 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Request method failure captured: Jun 07 14:23:53.691384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 HTTP/1.1 Jun 07 14:23:53.691384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:23:53.691384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:23:53.691384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:23:53.691384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:23:53.691384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:23:53.691384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:23:53.691384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:23:53.691384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:23:53.691384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin19PUI20ECdnE3AWzXfl0EbVHP3vT8kFaBWtD5Q9HBfcXfI468y0xXcwxPNP-KpfFWVExuERoYd05U0Xai80T-MVJr15ydAvT2caurNxVEcqbiHqnMb_5pw2heyETPR3flKUMDCrV13GiCXBl8mHmLArV3-zq2u_mJEreKNTRZEfhG8 Jun 07 14:23:53.691384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:23:53.691384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:23:53.691384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:23:53.691384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:23:53.691384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:23:53.691384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:23:53.691384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: ecb2b7cbdaf9495480fc881e823c1913 Jun 07 14:23:53.691384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-VolumesActionsTest-1059601317 Jun 07 14:23:53.691384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:23:53.691384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:23:53.692919 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ecb2b7cbdaf9495480fc881e823c1913"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ecb2b7cbdaf9495480fc881e823c1913", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ecb2b7cbdaf9495480fc881e823c1913"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ecb2b7cbdaf9495480fc881e823c1913"}]}] Jun 07 14:23:53.692919 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-VolumesActionsTest-1059601317 Jun 07 14:23:53.692919 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: ecb2b7cbdaf9495480fc881e823c1913 Jun 07 14:23:53.692919 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-VolumesActionsTest-1059601317 Jun 07 14:23:53.692919 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-VolumesActionsTest-1059601317-project Jun 07 14:23:53.692919 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:23:53.692919 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:23:53.692919 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: becdcd1df4a641e6a5bda05220f7aa07 Jun 07 14:23:53.692919 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-VolumesActionsTest-1059601317-project Jun 07 14:23:53.692919 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:23:53.692919 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance 48a95090-dd7c-4e27-92ee-e11af90f53e4 could not be found. Jun 07 14:23:53.692919 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': '48a95090-dd7c-4e27-92ee-e11af90f53e4'} Jun 07 14:23:53.693847 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:23:53.693847 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:23:53.693847 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:23:53.693847 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:23:53.693847 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:23:53.693847 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:23:53.693847 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:23:53.693847 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:23:53.693847 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:23:53.693847 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:23:53.693847 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48a95090-dd7c-4e27-92ee-e11af90f53e4 could not be found. Jun 07 14:23:53.693847 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:23:53.693847 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:23:53.693847 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:23:53.693847 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:23:53.693847 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:23:53.693847 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:23:53.693847 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:23:53.693847 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:23:53.693847 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:23:53.699437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:23:53.699437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:23:53.699437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:23:53.699437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:23:53.699437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:23:53.699437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:23:53.699437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:23:53.699437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48a95090-dd7c-4e27-92ee-e11af90f53e4 could not be found. Jun 07 14:23:53.699437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:23:53.699437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:23:53.699437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:23:53.699437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:23:53.699437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:23:53.699437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:23:53.699437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:23:53.699437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:23:53.699437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48a95090-dd7c-4e27-92ee-e11af90f53e4 could not be found. Jun 07 14:23:53.699437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:23:53.700548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-a9437e5a-e178-440b-b7a3-f19a43160a97 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Returning 404 to user: Instance 48a95090-dd7c-4e27-92ee-e11af90f53e4 could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:23:53.700548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-a9437e5a-e178-440b-b7a3-f19a43160a97 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4" status: 404 len: 111 microversion: 2.1 time: 0.036866 Jun 07 14:23:53.700548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 159/312] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:53 2022] GET /compute/v2.1/servers/48a95090-dd7c-4e27-92ee-e11af90f53e4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:23:53.800625 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e02b7fe6-6f2a-400f-a4ef-5234b9a9d0ce tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-386025147", "imageRef": "2864004b-970a-480b-8453-14794f9ccca2", "flavorRef": "452", "networks": [{"uuid": "852d511c-cad0-48ac-b18c-ff9209889a76"}]}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:23:53.854787 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.network.neutron [None req-e02b7fe6-6f2a-400f-a4ef-5234b9a9d0ce tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] validate_networks() for [('852d511c-cad0-48ac-b18c-ff9209889a76', None, None, None, None, None)] {{(pid=117564) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:23:54.056505 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-1e453500-ba7b-4899-bc14-fe613ebbd371 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:54.057857 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-1e453500-ba7b-4899-bc14-fe613ebbd371 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:54.065407 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1e453500-ba7b-4899-bc14-fe613ebbd371 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:54.065407 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1e453500-ba7b-4899-bc14-fe613ebbd371 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:54.066276 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1e453500-ba7b-4899-bc14-fe613ebbd371 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:54.066716 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1e453500-ba7b-4899-bc14-fe613ebbd371 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:54.292415 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-1e453500-ba7b-4899-bc14-fe613ebbd371 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:54.301236 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-1e453500-ba7b-4899-bc14-fe613ebbd371 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c" status: 200 len: 1507 microversion: 2.1 time: 0.251256 Jun 07 14:23:54.302103 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 160/313] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:54 2022] GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:23:54.308055 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7c4529f1-9002-4043-a049-3cc142cb3840 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:54.309062 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-7c4529f1-9002-4043-a049-3cc142cb3840 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:54.321238 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7c4529f1-9002-4043-a049-3cc142cb3840 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:54.321692 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7c4529f1-9002-4043-a049-3cc142cb3840 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:54.323677 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7c4529f1-9002-4043-a049-3cc142cb3840 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:54.324125 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7c4529f1-9002-4043-a049-3cc142cb3840 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:54.334232 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-e02b7fe6-6f2a-400f-a4ef-5234b9a9d0ce tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Flavor limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:23:54.334817 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-e02b7fe6-6f2a-400f-a4ef-5234b9a9d0ce tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Image limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:23:54.335447 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-e02b7fe6-6f2a-400f-a4ef-5234b9a9d0ce tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Flavor pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:23:54.335975 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-e02b7fe6-6f2a-400f-a4ef-5234b9a9d0ce tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Image pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:23:54.336486 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-e02b7fe6-6f2a-400f-a4ef-5234b9a9d0ce tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:23:54.348684 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e02b7fe6-6f2a-400f-a4ef-5234b9a9d0ce tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:54.349721 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e02b7fe6-6f2a-400f-a4ef-5234b9a9d0ce tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:54.350994 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e02b7fe6-6f2a-400f-a4ef-5234b9a9d0ce tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:54.351667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e02b7fe6-6f2a-400f-a4ef-5234b9a9d0ce tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:54.370539 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:54.371349 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-e02b7fe6-6f2a-400f-a4ef-5234b9a9d0ce tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Getting quotas for project ecb2b7cbdaf9495480fc881e823c1913. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:23:54.375861 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-e02b7fe6-6f2a-400f-a4ef-5234b9a9d0ce tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Getting quotas for user becdcd1df4a641e6a5bda05220f7aa07 and project ecb2b7cbdaf9495480fc881e823c1913. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:23:54.403982 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e02b7fe6-6f2a-400f-a4ef-5234b9a9d0ce tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Going to run 1 instances... {{(pid=117564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:23:54.406663 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e02b7fe6-6f2a-400f-a4ef-5234b9a9d0ce tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2864004b-970a-480b-8453-14794f9ccca2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:23:54.466412 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e02b7fe6-6f2a-400f-a4ef-5234b9a9d0ce tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669277 Jun 07 14:23:54.467329 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 154/314] 10.222.0.81 () {60 vars in 1146 bytes} [Tue Jun 7 14:23:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:23:54.479823 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-54e8145c-a882-46c2-9ef7-20ec22ef809f tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:54.480319 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-54e8145c-a882-46c2-9ef7-20ec22ef809f tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:54.568886 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-7c4529f1-9002-4043-a049-3cc142cb3840 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:54.584797 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-54e8145c-a882-46c2-9ef7-20ec22ef809f tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:54.589140 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-7c4529f1-9002-4043-a049-3cc142cb3840 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.276851 Jun 07 14:23:54.590368 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 161/315] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:54 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:54.594484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-54e8145c-a882-46c2-9ef7-20ec22ef809f tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1213 microversion: 2.1 time: 0.120632 Jun 07 14:23:54.595051 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 155/316] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:54 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1213 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:54.657899 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-e7f9af29-0be2-44e7-bb2f-f37caa124d66 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:54.658625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-e7f9af29-0be2-44e7-bb2f-f37caa124d66 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:54.676095 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e7f9af29-0be2-44e7-bb2f-f37caa124d66 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:54.676607 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e7f9af29-0be2-44e7-bb2f-f37caa124d66 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:54.677354 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e7f9af29-0be2-44e7-bb2f-f37caa124d66 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:54.677853 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e7f9af29-0be2-44e7-bb2f-f37caa124d66 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:54.881033 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-e7f9af29-0be2-44e7-bb2f-f37caa124d66 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:54.890461 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-e7f9af29-0be2-44e7-bb2f-f37caa124d66 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1719 microversion: 2.1 time: 0.236399 Jun 07 14:23:54.891394 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 162/317] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:54 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1719 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:55.608300 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1557ae1b-75ad-4ee7-b95c-432a36813d7d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:55.609642 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1557ae1b-75ad-4ee7-b95c-432a36813d7d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:55.613976 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-2f01c58b-567e-49fe-87c6-23e3f125a784 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:55.615018 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-2f01c58b-567e-49fe-87c6-23e3f125a784 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:55.618861 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1557ae1b-75ad-4ee7-b95c-432a36813d7d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:55.620366 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1557ae1b-75ad-4ee7-b95c-432a36813d7d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:55.621172 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1557ae1b-75ad-4ee7-b95c-432a36813d7d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:55.621773 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1557ae1b-75ad-4ee7-b95c-432a36813d7d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:55.625628 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2f01c58b-567e-49fe-87c6-23e3f125a784 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:55.642330 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2f01c58b-567e-49fe-87c6-23e3f125a784 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:55.645832 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2f01c58b-567e-49fe-87c6-23e3f125a784 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:55.649775 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2f01c58b-567e-49fe-87c6-23e3f125a784 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:55.820344 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-2f01c58b-567e-49fe-87c6-23e3f125a784 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:55.832270 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-2f01c58b-567e-49fe-87c6-23e3f125a784 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1217 microversion: 2.1 time: 0.224558 Jun 07 14:23:55.835355 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 163/318] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:55 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1217 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:23:55.867004 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1557ae1b-75ad-4ee7-b95c-432a36813d7d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:55.875895 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1557ae1b-75ad-4ee7-b95c-432a36813d7d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.272366 Jun 07 14:23:55.876583 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 156/319] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:55 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:23:55.912203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-2ced7d26-a62b-4a90-a7d8-c5fa65d602a7 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:55.913084 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-2ced7d26-a62b-4a90-a7d8-c5fa65d602a7 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:55.920170 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2ced7d26-a62b-4a90-a7d8-c5fa65d602a7 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:55.920912 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2ced7d26-a62b-4a90-a7d8-c5fa65d602a7 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:55.922034 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2ced7d26-a62b-4a90-a7d8-c5fa65d602a7 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:55.922628 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2ced7d26-a62b-4a90-a7d8-c5fa65d602a7 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:56.115853 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-2ced7d26-a62b-4a90-a7d8-c5fa65d602a7 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:56.125868 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-2ced7d26-a62b-4a90-a7d8-c5fa65d602a7 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1719 microversion: 2.1 time: 0.217569 Jun 07 14:23:56.126558 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 164/320] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:55 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1719 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:56.852128 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a08a796e-097f-4b5d-9d4b-62dcd714f18b tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:56.853177 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a08a796e-097f-4b5d-9d4b-62dcd714f18b tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:56.864432 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a08a796e-097f-4b5d-9d4b-62dcd714f18b tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:56.864883 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a08a796e-097f-4b5d-9d4b-62dcd714f18b tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:56.865864 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a08a796e-097f-4b5d-9d4b-62dcd714f18b tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:56.866511 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a08a796e-097f-4b5d-9d4b-62dcd714f18b tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:56.897687 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-2a86b5ad-97e2-4e00-87f7-2aa85676d304 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:56.898982 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-2a86b5ad-97e2-4e00-87f7-2aa85676d304 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:56.906480 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2a86b5ad-97e2-4e00-87f7-2aa85676d304 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:56.906926 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2a86b5ad-97e2-4e00-87f7-2aa85676d304 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:56.907718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2a86b5ad-97e2-4e00-87f7-2aa85676d304 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:56.908308 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2a86b5ad-97e2-4e00-87f7-2aa85676d304 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:56.946922 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a08a796e-097f-4b5d-9d4b-62dcd714f18b tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:56.958883 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a08a796e-097f-4b5d-9d4b-62dcd714f18b tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1283 microversion: 2.1 time: 0.112781 Jun 07 14:23:56.959499 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 157/321] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:56 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1283 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:57.090024 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-2a86b5ad-97e2-4e00-87f7-2aa85676d304 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:57.104286 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-2a86b5ad-97e2-4e00-87f7-2aa85676d304 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.210508 Jun 07 14:23:57.116036 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 165/322] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:56 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:57.145712 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e8f011cd-2f02-4985-876b-6ac638099a58 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:57.146536 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e8f011cd-2f02-4985-876b-6ac638099a58 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:57.170140 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e8f011cd-2f02-4985-876b-6ac638099a58 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:57.170992 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e8f011cd-2f02-4985-876b-6ac638099a58 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:57.172111 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e8f011cd-2f02-4985-876b-6ac638099a58 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:57.172697 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e8f011cd-2f02-4985-876b-6ac638099a58 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:57.410203 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e8f011cd-2f02-4985-876b-6ac638099a58 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:57.419827 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e8f011cd-2f02-4985-876b-6ac638099a58 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1719 microversion: 2.1 time: 0.280112 Jun 07 14:23:57.420415 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 158/323] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:57 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1719 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:57.977125 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-01973731-6d01-47c8-b6ef-5fcd009b89db tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:57.977739 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-01973731-6d01-47c8-b6ef-5fcd009b89db tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:57.984407 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-01973731-6d01-47c8-b6ef-5fcd009b89db tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:57.985110 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-01973731-6d01-47c8-b6ef-5fcd009b89db tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:57.985611 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-01973731-6d01-47c8-b6ef-5fcd009b89db tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:57.986050 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-01973731-6d01-47c8-b6ef-5fcd009b89db tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:58.123761 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3f15d1e8-b623-4af0-8f77-d7fa271b9163 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:58.125155 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3f15d1e8-b623-4af0-8f77-d7fa271b9163 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:58.135587 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3f15d1e8-b623-4af0-8f77-d7fa271b9163 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:58.136301 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3f15d1e8-b623-4af0-8f77-d7fa271b9163 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:58.137374 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3f15d1e8-b623-4af0-8f77-d7fa271b9163 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:58.138019 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3f15d1e8-b623-4af0-8f77-d7fa271b9163 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:58.144772 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-01973731-6d01-47c8-b6ef-5fcd009b89db tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:58.153795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-01973731-6d01-47c8-b6ef-5fcd009b89db tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1313 microversion: 2.1 time: 0.180396 Jun 07 14:23:58.154721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 166/324] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:57 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:58.316341 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3f15d1e8-b623-4af0-8f77-d7fa271b9163 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:58.325178 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3f15d1e8-b623-4af0-8f77-d7fa271b9163 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1501 microversion: 2.1 time: 0.205184 Jun 07 14:23:58.338592 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 159/325] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:58 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1501 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:23:58.345493 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-6085f41e-f950-4a4e-8e8b-134086eeceb4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5823958e-1241-4603-967b-46fdae73997f"}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:23:58.357437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-6085f41e-f950-4a4e-8e8b-134086eeceb4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:58.363996 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6085f41e-f950-4a4e-8e8b-134086eeceb4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:58.364528 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6085f41e-f950-4a4e-8e8b-134086eeceb4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:58.365184 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6085f41e-f950-4a4e-8e8b-134086eeceb4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:58.365616 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6085f41e-f950-4a4e-8e8b-134086eeceb4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:58.394823 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-6085f41e-f950-4a4e-8e8b-134086eeceb4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] HTTP exception thrown: Cannot 'attach_volume' instance 4dd5700e-2891-4b99-ba1f-d5304a5c8f58 while it is in vm_state rescued Jun 07 14:23:58.396411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-6085f41e-f950-4a4e-8e8b-134086eeceb4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Request method failure captured: Jun 07 14:23:58.396411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: POST /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58/os-volume_attachments HTTP/1.1 Jun 07 14:23:58.396411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:23:58.396411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:23:58.396411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:23:58.396411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 74 Jun 07 14:23:58.396411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:23:58.396411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:23:58.396411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:23:58.396411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:23:58.396411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin17phWIJ_eQLsN9FOFsHWkCoa6NydW99S4V4yhx6nzXRUhevbmuM6FHueSJUBAhq0lRznadD50RBaf_KCwvLxd5hok2blY9CUWxTTfms_YMLnlhwe8EVLpd2UFPRe-bhvJMSOHgvXQUvrD7rxrLP2RKctJbF_rKq76mqAGT8baB5Tpo Jun 07 14:23:58.396411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:23:58.396411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:23:58.396411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:23:58.396411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:23:58.396411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:23:58.396411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:23:58.396411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: ec8e48464f6a4d1886aaf89cc8b28e5f Jun 07 14:23:58.396411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-444301016 Jun 07 14:23:58.396411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:23:58.396411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:23:58.397961 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ec8e48464f6a4d1886aaf89cc8b28e5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ec8e48464f6a4d1886aaf89cc8b28e5f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ec8e48464f6a4d1886aaf89cc8b28e5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ec8e48464f6a4d1886aaf89cc8b28e5f"}]}] Jun 07 14:23:58.397961 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-ServerRescueNegativeTestJSON-444301016 Jun 07 14:23:58.397961 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: ec8e48464f6a4d1886aaf89cc8b28e5f Jun 07 14:23:58.397961 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-444301016 Jun 07 14:23:58.397961 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-ServerRescueNegativeTestJSON-444301016-project Jun 07 14:23:58.397961 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:23:58.397961 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:23:58.397961 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: d20025ab12f4450da20c8e41b931b5fc Jun 07 14:23:58.397961 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-ServerRescueNegativeTestJSON-444301016-project Jun 07 14:23:58.397961 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Jun 07 14:23:58.397961 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {"volumeAttachment": {"volumeId": "5823958e-1241-4603-967b-46fdae73997f"}} Jun 07 14:23:58.397961 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:23:58.398718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Cannot 'attach_volume' instance 4dd5700e-2891-4b99-ba1f-d5304a5c8f58 while it is in vm_state rescued Jun 07 14:23:58.398718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'server_id': '4dd5700e-2891-4b99-ba1f-d5304a5c8f58', 'body': {'volumeAttachment': {'volumeId': '5823958e-1241-4603-967b-46fdae73997f'}}} Jun 07 14:23:58.398718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:23:58.398718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:23:58.398718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 14:23:58.398718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 14:23:58.398718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 14:23:58.398718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 14:23:58.398718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 07 14:23:58.398718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 07 14:23:58.398718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4dd5700e-2891-4b99-ba1f-d5304a5c8f58 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 07 14:23:58.398718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:23:58.398718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:23:58.398718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:23:58.398718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:23:58.398718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:23:58.398718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:23:58.398718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:23:58.398718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:23:58.400100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:23:58.400100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:23:58.400100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 14:23:58.400100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 14:23:58.400100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 14:23:58.400100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 14:23:58.400100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 14:23:58.400100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 14:23:58.400100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 07 14:23:58.400100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 07 14:23:58.400100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 07 14:23:58.400100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 07 14:23:58.400100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4dd5700e-2891-4b99-ba1f-d5304a5c8f58 while it is in vm_state rescued Jun 07 14:23:58.400100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:23:58.400100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:23:58.400100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:23:58.400100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:23:58.400100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:23:58.400100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:23:58.402502 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:23:58.402502 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:23:58.402502 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4dd5700e-2891-4b99-ba1f-d5304a5c8f58 while it is in vm_state rescued Jun 07 14:23:58.402502 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:23:58.402502 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-6085f41e-f950-4a4e-8e8b-134086eeceb4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Returning 409 to user: Cannot 'attach_volume' instance 4dd5700e-2891-4b99-ba1f-d5304a5c8f58 while it is in vm_state rescued {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:23:58.402502 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-6085f41e-f950-4a4e-8e8b-134086eeceb4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "POST /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.058673 Jun 07 14:23:58.402502 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 167/326] 10.222.0.81 () {60 vars in 1322 bytes} [Tue Jun 7 14:23:58 2022] POST /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58/os-volume_attachments => generated 152 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 07 14:23:58.407354 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-46f29e30-b38b-49d8-85c6-1fc14f07b4a0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:23:58.407888 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-46f29e30-b38b-49d8-85c6-1fc14f07b4a0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:58.413828 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-46f29e30-b38b-49d8-85c6-1fc14f07b4a0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:58.414292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-46f29e30-b38b-49d8-85c6-1fc14f07b4a0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:58.415258 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-46f29e30-b38b-49d8-85c6-1fc14f07b4a0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:58.415699 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-46f29e30-b38b-49d8-85c6-1fc14f07b4a0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:58.436734 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-bcff2585-94a9-430e-9c41-b03a263cdbdf tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:58.437328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-bcff2585-94a9-430e-9c41-b03a263cdbdf tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:58.444608 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bcff2585-94a9-430e-9c41-b03a263cdbdf tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:58.445052 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bcff2585-94a9-430e-9c41-b03a263cdbdf tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:58.445671 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:58.446015 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bcff2585-94a9-430e-9c41-b03a263cdbdf tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:58.446593 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bcff2585-94a9-430e-9c41-b03a263cdbdf tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:58.489359 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-46f29e30-b38b-49d8-85c6-1fc14f07b4a0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "POST /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58/action" status: 202 len: 0 microversion: 2.1 time: 0.085663 Jun 07 14:23:58.493231 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 160/327] 10.222.0.81 () {60 vars in 1277 bytes} [Tue Jun 7 14:23:58 2022] POST /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 14:23:58.500832 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-70084350-8627-4638-b1bf-105607933399 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:58.501744 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-70084350-8627-4638-b1bf-105607933399 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:58.508682 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-70084350-8627-4638-b1bf-105607933399 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:58.509174 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-70084350-8627-4638-b1bf-105607933399 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:58.511486 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-70084350-8627-4638-b1bf-105607933399 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:58.511486 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-70084350-8627-4638-b1bf-105607933399 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:58.628914 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-bcff2585-94a9-430e-9c41-b03a263cdbdf tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:58.637968 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-bcff2585-94a9-430e-9c41-b03a263cdbdf tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1719 microversion: 2.1 time: 0.204915 Jun 07 14:23:58.638581 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 168/328] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:58 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1719 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:23:58.675332 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-70084350-8627-4638-b1bf-105607933399 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:58.683326 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-70084350-8627-4638-b1bf-105607933399 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1509 microversion: 2.1 time: 0.187795 Jun 07 14:23:58.683897 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 161/329] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:58 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:23:59.173815 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-5744901e-3260-43f0-8dba-4883cfd0784e tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:59.174470 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-5744901e-3260-43f0-8dba-4883cfd0784e tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:59.185653 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5744901e-3260-43f0-8dba-4883cfd0784e tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:59.186108 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5744901e-3260-43f0-8dba-4883cfd0784e tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:59.186946 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5744901e-3260-43f0-8dba-4883cfd0784e tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:59.187528 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5744901e-3260-43f0-8dba-4883cfd0784e tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:59.323500 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-5744901e-3260-43f0-8dba-4883cfd0784e tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:59.330874 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-5744901e-3260-43f0-8dba-4883cfd0784e tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1313 microversion: 2.1 time: 0.160906 Jun 07 14:23:59.331483 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 169/330] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:59 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:59.655145 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c2122403-58ba-43ee-b64b-ed2f38c3d2ca tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:59.655785 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c2122403-58ba-43ee-b64b-ed2f38c3d2ca tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:59.662870 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c2122403-58ba-43ee-b64b-ed2f38c3d2ca tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:59.663356 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c2122403-58ba-43ee-b64b-ed2f38c3d2ca tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:59.664116 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c2122403-58ba-43ee-b64b-ed2f38c3d2ca tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:59.664548 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c2122403-58ba-43ee-b64b-ed2f38c3d2ca tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:59.700352 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-9e20154b-6e1f-4aad-a180-15e45fa7771e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:23:59.700966 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-9e20154b-6e1f-4aad-a180-15e45fa7771e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:23:59.709597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9e20154b-6e1f-4aad-a180-15e45fa7771e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:59.710053 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9e20154b-6e1f-4aad-a180-15e45fa7771e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:59.710838 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9e20154b-6e1f-4aad-a180-15e45fa7771e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:23:59.711305 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9e20154b-6e1f-4aad-a180-15e45fa7771e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:23:59.853407 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c2122403-58ba-43ee-b64b-ed2f38c3d2ca tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:59.864742 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c2122403-58ba-43ee-b64b-ed2f38c3d2ca tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1719 microversion: 2.1 time: 0.213295 Jun 07 14:23:59.865405 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 162/331] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:59 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1719 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:23:59.889678 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-9e20154b-6e1f-4aad-a180-15e45fa7771e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:23:59.897392 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-9e20154b-6e1f-4aad-a180-15e45fa7771e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1509 microversion: 2.1 time: 0.201135 Jun 07 14:23:59.898216 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 170/332] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:23:59 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1509 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:00.347335 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0e1b40ab-2026-4e52-9112-277e2ba0cf46 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:00.348485 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0e1b40ab-2026-4e52-9112-277e2ba0cf46 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:00.355060 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0e1b40ab-2026-4e52-9112-277e2ba0cf46 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:00.355662 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0e1b40ab-2026-4e52-9112-277e2ba0cf46 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:00.356519 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0e1b40ab-2026-4e52-9112-277e2ba0cf46 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:00.357023 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0e1b40ab-2026-4e52-9112-277e2ba0cf46 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:00.503976 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0e1b40ab-2026-4e52-9112-277e2ba0cf46 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:00.512312 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0e1b40ab-2026-4e52-9112-277e2ba0cf46 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1313 microversion: 2.1 time: 0.168879 Jun 07 14:24:00.512878 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 163/333] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:00 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:00.882866 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-9710d166-0ce0-4ad2-ac78-079a4fda2f2f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:00.883677 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-9710d166-0ce0-4ad2-ac78-079a4fda2f2f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:00.891383 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9710d166-0ce0-4ad2-ac78-079a4fda2f2f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:00.891913 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9710d166-0ce0-4ad2-ac78-079a4fda2f2f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:00.892836 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9710d166-0ce0-4ad2-ac78-079a4fda2f2f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:00.893322 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9710d166-0ce0-4ad2-ac78-079a4fda2f2f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:00.917495 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-16e0cfc8-fa5f-4654-978b-36a69d66a6b9 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:00.918082 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-16e0cfc8-fa5f-4654-978b-36a69d66a6b9 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:00.926386 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-16e0cfc8-fa5f-4654-978b-36a69d66a6b9 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:00.927093 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-16e0cfc8-fa5f-4654-978b-36a69d66a6b9 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:00.929042 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-16e0cfc8-fa5f-4654-978b-36a69d66a6b9 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:00.929678 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-16e0cfc8-fa5f-4654-978b-36a69d66a6b9 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:01.119512 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-9710d166-0ce0-4ad2-ac78-079a4fda2f2f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:01.123601 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-16e0cfc8-fa5f-4654-978b-36a69d66a6b9 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:01.128367 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-9710d166-0ce0-4ad2-ac78-079a4fda2f2f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1719 microversion: 2.1 time: 0.249557 Jun 07 14:24:01.129193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 171/334] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:00 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1719 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:01.131115 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-16e0cfc8-fa5f-4654-978b-36a69d66a6b9 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1509 microversion: 2.1 time: 0.218374 Jun 07 14:24:01.131705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 164/335] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:00 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1509 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:01.530186 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-76a51d6e-60d6-4966-9d71-f8f4b32d6efd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:01.530897 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-76a51d6e-60d6-4966-9d71-f8f4b32d6efd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:01.543726 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-76a51d6e-60d6-4966-9d71-f8f4b32d6efd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:01.544496 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-76a51d6e-60d6-4966-9d71-f8f4b32d6efd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:01.546452 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-76a51d6e-60d6-4966-9d71-f8f4b32d6efd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:01.547237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-76a51d6e-60d6-4966-9d71-f8f4b32d6efd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:01.781817 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-76a51d6e-60d6-4966-9d71-f8f4b32d6efd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:01.790287 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-76a51d6e-60d6-4966-9d71-f8f4b32d6efd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1313 microversion: 2.1 time: 0.265332 Jun 07 14:24:01.790955 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 172/336] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:01 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:02.116779 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-c2110d05-f7fd-47c7-bbc2-9284dc2a8a24 req-adbc6330-6f60-4f44-8c05-edb6b0051cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7506222-1035-4ee1-a699-9e34c48aebf6", "tag": "4f31b9bd-b25a-4f81-a6f5-a3395bf00234"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:24:02.129107 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-c2110d05-f7fd-47c7-bbc2-9284dc2a8a24 req-adbc6330-6f60-4f44-8c05-edb6b0051cc5 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:02.130384 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-c2110d05-f7fd-47c7-bbc2-9284dc2a8a24 req-adbc6330-6f60-4f44-8c05-edb6b0051cc5 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:02.148067 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-5d20c7c2-63d8-4931-868a-f60bd26cae95 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:02.149468 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-5d20c7c2-63d8-4931-868a-f60bd26cae95 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:02.156125 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5d20c7c2-63d8-4931-868a-f60bd26cae95 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:02.156577 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5d20c7c2-63d8-4931-868a-f60bd26cae95 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:02.157557 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5d20c7c2-63d8-4931-868a-f60bd26cae95 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:02.157993 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5d20c7c2-63d8-4931-868a-f60bd26cae95 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:02.160034 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-c2110d05-f7fd-47c7-bbc2-9284dc2a8a24 req-adbc6330-6f60-4f44-8c05-edb6b0051cc5 service nova] Creating event network-changed:4f31b9bd-b25a-4f81-a6f5-a3395bf00234 for instance d7506222-1035-4ee1-a699-9e34c48aebf6 on hv-cinder-83608 Jun 07 14:24:02.172758 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-c2110d05-f7fd-47c7-bbc2-9284dc2a8a24 req-adbc6330-6f60-4f44-8c05-edb6b0051cc5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061096 Jun 07 14:24:02.173909 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 165/337] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:24:02.184504 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a03ae70d-d410-49a8-9982-e05bd241b788 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:02.185333 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a03ae70d-d410-49a8-9982-e05bd241b788 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:02.193894 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a03ae70d-d410-49a8-9982-e05bd241b788 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:02.195103 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a03ae70d-d410-49a8-9982-e05bd241b788 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:02.196002 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a03ae70d-d410-49a8-9982-e05bd241b788 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:02.196441 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a03ae70d-d410-49a8-9982-e05bd241b788 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:02.455688 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-5d20c7c2-63d8-4931-868a-f60bd26cae95 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:02.457278 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a03ae70d-d410-49a8-9982-e05bd241b788 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:02.465887 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a03ae70d-d410-49a8-9982-e05bd241b788 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1509 microversion: 2.1 time: 0.290766 Jun 07 14:24:02.466039 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-5d20c7c2-63d8-4931-868a-f60bd26cae95 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1719 microversion: 2.1 time: 0.321939 Jun 07 14:24:02.466526 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 173/338] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:02 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1719 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:02.471622 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 166/339] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:02 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1509 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:02.807010 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-1790a9f6-875b-491d-bedf-926d5b163843 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:02.807569 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-1790a9f6-875b-491d-bedf-926d5b163843 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:02.814129 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1790a9f6-875b-491d-bedf-926d5b163843 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:02.814605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1790a9f6-875b-491d-bedf-926d5b163843 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:02.815399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1790a9f6-875b-491d-bedf-926d5b163843 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:02.815836 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1790a9f6-875b-491d-bedf-926d5b163843 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:02.960290 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-1790a9f6-875b-491d-bedf-926d5b163843 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:02.968221 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-1790a9f6-875b-491d-bedf-926d5b163843 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1313 microversion: 2.1 time: 0.165207 Jun 07 14:24:02.968798 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 174/340] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:02 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:03.487668 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d91391d3-6305-4a58-9e0a-6bfaee868d88 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:03.488278 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d91391d3-6305-4a58-9e0a-6bfaee868d88 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:03.488830 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-a616d9f4-92b0-4dc6-b9c3-d8332c567e9f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:03.490199 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-a616d9f4-92b0-4dc6-b9c3-d8332c567e9f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:03.496447 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d91391d3-6305-4a58-9e0a-6bfaee868d88 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:03.497143 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d91391d3-6305-4a58-9e0a-6bfaee868d88 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:03.497634 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a616d9f4-92b0-4dc6-b9c3-d8332c567e9f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:03.498093 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a616d9f4-92b0-4dc6-b9c3-d8332c567e9f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:03.498197 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d91391d3-6305-4a58-9e0a-6bfaee868d88 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:03.498892 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d91391d3-6305-4a58-9e0a-6bfaee868d88 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:03.498993 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a616d9f4-92b0-4dc6-b9c3-d8332c567e9f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:03.499359 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a616d9f4-92b0-4dc6-b9c3-d8332c567e9f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:03.715839 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-a616d9f4-92b0-4dc6-b9c3-d8332c567e9f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:03.734039 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-d91391d3-6305-4a58-9e0a-6bfaee868d88 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:03.741683 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-a616d9f4-92b0-4dc6-b9c3-d8332c567e9f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1509 microversion: 2.1 time: 0.256261 Jun 07 14:24:03.742442 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 175/341] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:03 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1509 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:03.757335 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d91391d3-6305-4a58-9e0a-6bfaee868d88 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1719 microversion: 2.1 time: 0.273008 Jun 07 14:24:03.758653 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 167/342] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:03 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1719 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:03.986598 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-762f9c73-944a-460a-a168-47a22428875d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:03.987401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-762f9c73-944a-460a-a168-47a22428875d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:03.994811 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-762f9c73-944a-460a-a168-47a22428875d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:03.996095 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-762f9c73-944a-460a-a168-47a22428875d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:03.997477 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-762f9c73-944a-460a-a168-47a22428875d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:03.997928 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-762f9c73-944a-460a-a168-47a22428875d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:04.286443 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-762f9c73-944a-460a-a168-47a22428875d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:04.294470 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-762f9c73-944a-460a-a168-47a22428875d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1313 microversion: 2.1 time: 0.311944 Jun 07 14:24:04.295040 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 176/343] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:03 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:04.759003 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-642d29e8-526a-4ed2-88d5-114cbd0941a3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:04.759996 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-642d29e8-526a-4ed2-88d5-114cbd0941a3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:04.762755 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:04.764487 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=8 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:04.772911 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-642d29e8-526a-4ed2-88d5-114cbd0941a3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:04.773473 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-642d29e8-526a-4ed2-88d5-114cbd0941a3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:04.774511 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-642d29e8-526a-4ed2-88d5-114cbd0941a3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:04.775024 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-642d29e8-526a-4ed2-88d5-114cbd0941a3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:04.775158 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-78985cff-b7cb-4de3-bcaa-0b232fc3c2a0 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:04.775804 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-78985cff-b7cb-4de3-bcaa-0b232fc3c2a0 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:04.784813 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-78985cff-b7cb-4de3-bcaa-0b232fc3c2a0 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:04.785302 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-78985cff-b7cb-4de3-bcaa-0b232fc3c2a0 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:04.786092 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-78985cff-b7cb-4de3-bcaa-0b232fc3c2a0 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:04.786499 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-78985cff-b7cb-4de3-bcaa-0b232fc3c2a0 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:05.039334 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-642d29e8-526a-4ed2-88d5-114cbd0941a3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:05.049477 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-642d29e8-526a-4ed2-88d5-114cbd0941a3 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1515 microversion: 2.1 time: 0.294514 Jun 07 14:24:05.050065 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 168/344] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:04 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1515 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:05.065884 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-78985cff-b7cb-4de3-bcaa-0b232fc3c2a0 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:05.075112 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-78985cff-b7cb-4de3-bcaa-0b232fc3c2a0 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1719 microversion: 2.1 time: 0.303723 Jun 07 14:24:05.075895 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 177/345] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:04 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1719 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:05.312183 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b408c8c6-051e-44af-96ca-401d63bd385d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:05.312829 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b408c8c6-051e-44af-96ca-401d63bd385d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:05.321757 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b408c8c6-051e-44af-96ca-401d63bd385d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:05.322236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b408c8c6-051e-44af-96ca-401d63bd385d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:05.323014 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b408c8c6-051e-44af-96ca-401d63bd385d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:05.324165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b408c8c6-051e-44af-96ca-401d63bd385d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:05.512343 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b408c8c6-051e-44af-96ca-401d63bd385d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:05.520404 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b408c8c6-051e-44af-96ca-401d63bd385d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1313 microversion: 2.1 time: 0.212942 Jun 07 14:24:05.521432 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 169/346] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:05 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:06.093963 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-63e19b38-166f-4389-9d33-0542eb8f0ae9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:06.094660 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-63e19b38-166f-4389-9d33-0542eb8f0ae9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:06.102309 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-63e19b38-166f-4389-9d33-0542eb8f0ae9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:06.102762 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-63e19b38-166f-4389-9d33-0542eb8f0ae9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:06.103589 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-63e19b38-166f-4389-9d33-0542eb8f0ae9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:06.104073 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-63e19b38-166f-4389-9d33-0542eb8f0ae9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:06.109130 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=100 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:06.238785 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-63e19b38-166f-4389-9d33-0542eb8f0ae9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:06.247702 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-63e19b38-166f-4389-9d33-0542eb8f0ae9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1719 microversion: 2.1 time: 0.158360 Jun 07 14:24:06.248280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 178/347] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:06 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:06.423842 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-da49f32c-24d4-4218-a242-2877d5273d4b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Action: 'create', calling method: .version_select at 0x7ff37f7bc670>, body: {"keypair": {"name": "tempest-keypair-598497199", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXivgkFhPXjAUWJQjrrjm6cArmyja1fLddYtRo8GrEpxUf3m9etzPGFR6664U+Jenhv5FxCRMvcktJBS3iGj1iFEalQRMaz+fOs/s6yl8JBnRixH4hIOhQ9dsd3fOkTRQ=="}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:24:06.439431 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-da49f32c-24d4-4218-a242-2877d5273d4b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Getting quotas for project ec8e48464f6a4d1886aaf89cc8b28e5f. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:24:06.444054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-da49f32c-24d4-4218-a242-2877d5273d4b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Getting quotas for user d20025ab12f4450da20c8e41b931b5fc and project ec8e48464f6a4d1886aaf89cc8b28e5f. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:24:06.475441 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-da49f32c-24d4-4218-a242-2877d5273d4b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055600 Jun 07 14:24:06.476048 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 170/348] 10.222.0.81 () {60 vars in 1158 bytes} [Tue Jun 7 14:24:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:24:06.537900 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-e5a58e4c-1e02-477f-a7e8-601e07993000 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:06.539245 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-e5a58e4c-1e02-477f-a7e8-601e07993000 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:06.556973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e5a58e4c-1e02-477f-a7e8-601e07993000 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:06.558734 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e5a58e4c-1e02-477f-a7e8-601e07993000 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:06.562986 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e5a58e4c-1e02-477f-a7e8-601e07993000 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:06.564383 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e5a58e4c-1e02-477f-a7e8-601e07993000 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:06.878459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-e5a58e4c-1e02-477f-a7e8-601e07993000 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:06.895852 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-e5a58e4c-1e02-477f-a7e8-601e07993000 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1313 microversion: 2.1 time: 0.358222 Jun 07 14:24:06.896470 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 179/349] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:06 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:06.936646 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3e3ad3ff-d3e2-4b1a-b5fb-a77f88a1332a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1933131460", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1960209199", "security_groups": [{"name": "tempest-secgroup-smoke-134496627"}], "networks": [{"uuid": "f397386a-1f8f-428e-9db6-eb5c4da2745e"}], "block_device_mapping_v2": [{"uuid": "96d9f68e-bf49-4d67-ba1d-d067e4e9aac6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:24:07.075427 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.network.neutron [None req-3e3ad3ff-d3e2-4b1a-b5fb-a77f88a1332a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] validate_networks() for [('f397386a-1f8f-428e-9db6-eb5c4da2745e', None, None, None, None, None)] {{(pid=117564) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:24:07.265441 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-505d4524-b203-47f9-8982-12166805847f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:07.266224 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-505d4524-b203-47f9-8982-12166805847f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:07.294289 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-505d4524-b203-47f9-8982-12166805847f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:07.295141 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-505d4524-b203-47f9-8982-12166805847f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:07.296434 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-505d4524-b203-47f9-8982-12166805847f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:07.297084 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-505d4524-b203-47f9-8982-12166805847f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:07.547718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-505d4524-b203-47f9-8982-12166805847f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:07.557272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-505d4524-b203-47f9-8982-12166805847f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1696 microversion: 2.1 time: 0.296141 Jun 07 14:24:07.558810 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 180/350] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:07 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1696 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:07.575631 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-bc3ff662-a42e-4aef-aa94-1eabe0887780 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:24:07.583046 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bc3ff662-a42e-4aef-aa94-1eabe0887780 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:07.584036 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bc3ff662-a42e-4aef-aa94-1eabe0887780 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:07.600359 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-3e3ad3ff-d3e2-4b1a-b5fb-a77f88a1332a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Flavor limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:24:07.601339 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-3e3ad3ff-d3e2-4b1a-b5fb-a77f88a1332a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Image limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:24:07.601981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-3e3ad3ff-d3e2-4b1a-b5fb-a77f88a1332a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Flavor pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:24:07.602499 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-3e3ad3ff-d3e2-4b1a-b5fb-a77f88a1332a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Image pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:24:07.602992 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-3e3ad3ff-d3e2-4b1a-b5fb-a77f88a1332a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:24:07.616553 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3e3ad3ff-d3e2-4b1a-b5fb-a77f88a1332a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:07.627133 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3e3ad3ff-d3e2-4b1a-b5fb-a77f88a1332a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:07.628491 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3e3ad3ff-d3e2-4b1a-b5fb-a77f88a1332a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:07.629286 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3e3ad3ff-d3e2-4b1a-b5fb-a77f88a1332a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:07.652015 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-3e3ad3ff-d3e2-4b1a-b5fb-a77f88a1332a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Getting quotas for project b5977f5c113f44eebed133afa6238c2e. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:24:07.658617 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-3e3ad3ff-d3e2-4b1a-b5fb-a77f88a1332a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Getting quotas for user 86a6598d0d7c41faae54d48ea8a850d7 and project b5977f5c113f44eebed133afa6238c2e. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:24:07.669939 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-bc3ff662-a42e-4aef-aa94-1eabe0887780 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Going to try to start instance {{(pid=117565) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 07 14:24:07.727367 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-bc3ff662-a42e-4aef-aa94-1eabe0887780 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "POST /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b/action" status: 202 len: 0 microversion: 2.1 time: 0.156188 Jun 07 14:24:07.727969 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 181/351] 10.222.0.81 () {60 vars in 1277 bytes} [Tue Jun 7 14:24:07 2022] POST /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 14:24:07.737063 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-82321a2d-30a4-42e0-8b63-3da4625df131 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:07.737944 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-82321a2d-30a4-42e0-8b63-3da4625df131 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:07.739414 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3e3ad3ff-d3e2-4b1a-b5fb-a77f88a1332a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Going to run 1 instances... {{(pid=117564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:24:07.742499 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3e3ad3ff-d3e2-4b1a-b5fb-a77f88a1332a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='96d9f68e-bf49-4d67-ba1d-d067e4e9aac6',volume_size=None,volume_type=None)] {{(pid=117564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:24:07.755144 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-82321a2d-30a4-42e0-8b63-3da4625df131 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:07.759742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-82321a2d-30a4-42e0-8b63-3da4625df131 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:07.761395 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-82321a2d-30a4-42e0-8b63-3da4625df131 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:07.762089 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-82321a2d-30a4-42e0-8b63-3da4625df131 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:07.946356 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3e3ad3ff-d3e2-4b1a-b5fb-a77f88a1332a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.014307 Jun 07 14:24:07.947385 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 171/352] 10.222.0.81 () {60 vars in 1146 bytes} [Tue Jun 7 14:24:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:24:07.957462 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-cda03674-945d-4787-b254-dced6587d9c2 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:07.958801 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-cda03674-945d-4787-b254-dced6587d9c2 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:07.968184 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cda03674-945d-4787-b254-dced6587d9c2 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:07.968758 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cda03674-945d-4787-b254-dced6587d9c2 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:07.969635 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cda03674-945d-4787-b254-dced6587d9c2 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:07.970482 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cda03674-945d-4787-b254-dced6587d9c2 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:08.189917 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-82321a2d-30a4-42e0-8b63-3da4625df131 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:08.202512 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-82321a2d-30a4-42e0-8b63-3da4625df131 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1705 microversion: 2.1 time: 0.468714 Jun 07 14:24:08.204090 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 182/353] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:07 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1705 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:08.210266 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d11388d4-250d-4cf2-8e13-b2c3b1865f18 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:08.211244 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-d11388d4-250d-4cf2-8e13-b2c3b1865f18 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:08.353029 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-d11388d4-250d-4cf2-8e13-b2c3b1865f18 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:08.359416 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-cda03674-945d-4787-b254-dced6587d9c2 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:08.369535 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-cda03674-945d-4787-b254-dced6587d9c2 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1313 microversion: 2.1 time: 0.419654 Jun 07 14:24:08.372416 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-d11388d4-250d-4cf2-8e13-b2c3b1865f18 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1089 microversion: 2.1 time: 0.166893 Jun 07 14:24:08.372574 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 172/354] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:07 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:08.385600 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 183/355] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:08 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1089 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:08.614346 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-30259a03-4758-45f5-94d6-e9349e1d2e6c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-473878327", "imageRef": "2864004b-970a-480b-8453-14794f9ccca2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e29f253b-76e1-40c6-9128-7a3556b521e2"}], "security_groups": [{"name": "tempest-securitygroup--258406687"}], "key_name": "tempest-keypair-598497199", "user_data": "}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:24:08.829179 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.network.neutron [None req-30259a03-4758-45f5-94d6-e9349e1d2e6c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] validate_networks() for [('e29f253b-76e1-40c6-9128-7a3556b521e2', None, None, None, None, None)] {{(pid=117564) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:24:09.224748 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-680add75-6451-4419-b1cf-b33af665e466 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:09.225584 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-680add75-6451-4419-b1cf-b33af665e466 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:09.232959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-680add75-6451-4419-b1cf-b33af665e466 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:09.233399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-680add75-6451-4419-b1cf-b33af665e466 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:09.234165 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-680add75-6451-4419-b1cf-b33af665e466 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:09.234596 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-680add75-6451-4419-b1cf-b33af665e466 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:09.264397 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-30259a03-4758-45f5-94d6-e9349e1d2e6c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Flavor limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:24:09.264835 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-30259a03-4758-45f5-94d6-e9349e1d2e6c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Image limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:24:09.265318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-30259a03-4758-45f5-94d6-e9349e1d2e6c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Flavor pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:24:09.265738 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-30259a03-4758-45f5-94d6-e9349e1d2e6c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Image pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:24:09.266157 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-30259a03-4758-45f5-94d6-e9349e1d2e6c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:24:09.276957 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-30259a03-4758-45f5-94d6-e9349e1d2e6c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:09.277462 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-30259a03-4758-45f5-94d6-e9349e1d2e6c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:09.278490 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-30259a03-4758-45f5-94d6-e9349e1d2e6c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:09.278943 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-30259a03-4758-45f5-94d6-e9349e1d2e6c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:09.296631 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-30259a03-4758-45f5-94d6-e9349e1d2e6c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Getting quotas for project ec8e48464f6a4d1886aaf89cc8b28e5f. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:24:09.300482 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-30259a03-4758-45f5-94d6-e9349e1d2e6c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Getting quotas for user d20025ab12f4450da20c8e41b931b5fc and project ec8e48464f6a4d1886aaf89cc8b28e5f. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:24:09.302775 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:09.314901 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-30259a03-4758-45f5-94d6-e9349e1d2e6c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Going to run 1 instances... {{(pid=117564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:24:09.317052 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-30259a03-4758-45f5-94d6-e9349e1d2e6c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2864004b-970a-480b-8453-14794f9ccca2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:24:09.375701 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-30259a03-4758-45f5-94d6-e9349e1d2e6c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.765863 Jun 07 14:24:09.376361 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 173/356] 10.222.0.81 () {60 vars in 1146 bytes} [Tue Jun 7 14:24:08 2022] POST /compute/v2.1/servers => generated 408 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:24:09.386029 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a03133fd-d611-483f-a31a-5353a56d0622 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:09.386848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a03133fd-d611-483f-a31a-5353a56d0622 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:09.403939 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-680add75-6451-4419-b1cf-b33af665e466 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:09.420682 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-680add75-6451-4419-b1cf-b33af665e466 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1705 microversion: 2.1 time: 0.203053 Jun 07 14:24:09.421857 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 184/357] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:09 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1705 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:09.430750 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ef9bc640-2e93-45d2-907a-617877b0e3fc tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:09.431872 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ef9bc640-2e93-45d2-907a-617877b0e3fc tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:09.447199 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ef9bc640-2e93-45d2-907a-617877b0e3fc tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:09.448945 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ef9bc640-2e93-45d2-907a-617877b0e3fc tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:09.450568 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ef9bc640-2e93-45d2-907a-617877b0e3fc tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:09.451760 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ef9bc640-2e93-45d2-907a-617877b0e3fc tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:09.497039 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a03133fd-d611-483f-a31a-5353a56d0622 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:09.519182 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a03133fd-d611-483f-a31a-5353a56d0622 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1244 microversion: 2.1 time: 0.136840 Jun 07 14:24:09.530472 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 174/358] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:09 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1244 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:09.536034 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-46a652fb-e08e-41c5-8025-e4598e5a0cf0 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:09.536645 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-46a652fb-e08e-41c5-8025-e4598e5a0cf0 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:09.554842 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-46a652fb-e08e-41c5-8025-e4598e5a0cf0 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:09.559271 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-46a652fb-e08e-41c5-8025-e4598e5a0cf0 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:09.561024 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-46a652fb-e08e-41c5-8025-e4598e5a0cf0 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:09.562042 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-46a652fb-e08e-41c5-8025-e4598e5a0cf0 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:09.687444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-46a652fb-e08e-41c5-8025-e4598e5a0cf0 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:09.695617 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-46a652fb-e08e-41c5-8025-e4598e5a0cf0 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1205 microversion: 2.1 time: 0.163969 Jun 07 14:24:09.697599 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 175/359] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:09 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1205 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:09.731007 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ef9bc640-2e93-45d2-907a-617877b0e3fc tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:09.739287 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ef9bc640-2e93-45d2-907a-617877b0e3fc tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1313 microversion: 2.1 time: 0.315280 Jun 07 14:24:09.739927 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 185/360] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:09 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:10.440377 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-28545e9e-85ce-4e73-b30c-5ae35c5c1a09 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:10.441443 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-28545e9e-85ce-4e73-b30c-5ae35c5c1a09 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:10.449759 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-28545e9e-85ce-4e73-b30c-5ae35c5c1a09 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:10.450565 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-28545e9e-85ce-4e73-b30c-5ae35c5c1a09 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:10.452415 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-28545e9e-85ce-4e73-b30c-5ae35c5c1a09 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:10.453335 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-28545e9e-85ce-4e73-b30c-5ae35c5c1a09 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:10.536932 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-72d580a7-408b-424f-b3e4-4ae1589b4fa2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:10.538793 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-72d580a7-408b-424f-b3e4-4ae1589b4fa2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:10.548433 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-72d580a7-408b-424f-b3e4-4ae1589b4fa2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:10.549877 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-72d580a7-408b-424f-b3e4-4ae1589b4fa2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:10.550753 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-72d580a7-408b-424f-b3e4-4ae1589b4fa2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:10.552174 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-72d580a7-408b-424f-b3e4-4ae1589b4fa2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:10.693747 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-72d580a7-408b-424f-b3e4-4ae1589b4fa2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:10.705246 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-72d580a7-408b-424f-b3e4-4ae1589b4fa2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1248 microversion: 2.1 time: 0.171419 Jun 07 14:24:10.706385 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 186/361] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:10 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1248 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:10.721861 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-b771b514-a3e6-4c6c-a356-40f4231f12f6 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:10.722877 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-b771b514-a3e6-4c6c-a356-40f4231f12f6 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:10.731763 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b771b514-a3e6-4c6c-a356-40f4231f12f6 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:10.732212 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b771b514-a3e6-4c6c-a356-40f4231f12f6 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:10.733654 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b771b514-a3e6-4c6c-a356-40f4231f12f6 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:10.734108 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b771b514-a3e6-4c6c-a356-40f4231f12f6 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:10.748655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-28545e9e-85ce-4e73-b30c-5ae35c5c1a09 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:10.768336 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-28545e9e-85ce-4e73-b30c-5ae35c5c1a09 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1709 microversion: 2.1 time: 0.330276 Jun 07 14:24:10.768980 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 176/362] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:10 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1709 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:10.786386 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0499a9fa-5711-4cd7-a8f2-b1f245c11ea0 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:10.787262 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0499a9fa-5711-4cd7-a8f2-b1f245c11ea0 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:10.796024 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0499a9fa-5711-4cd7-a8f2-b1f245c11ea0 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:10.796593 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0499a9fa-5711-4cd7-a8f2-b1f245c11ea0 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:10.797474 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0499a9fa-5711-4cd7-a8f2-b1f245c11ea0 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:10.798037 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0499a9fa-5711-4cd7-a8f2-b1f245c11ea0 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:10.888950 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-b771b514-a3e6-4c6c-a356-40f4231f12f6 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:10.898381 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-b771b514-a3e6-4c6c-a356-40f4231f12f6 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1193 microversion: 2.1 time: 0.187452 Jun 07 14:24:10.899526 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 187/363] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:10 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1193 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:11.117811 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0499a9fa-5711-4cd7-a8f2-b1f245c11ea0 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:11.127593 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0499a9fa-5711-4cd7-a8f2-b1f245c11ea0 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1313 microversion: 2.1 time: 0.356966 Jun 07 14:24:11.128373 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 177/364] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:10 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:11.724543 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-8e3b2367-156f-48c4-b138-0ee267d35b16 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:11.725315 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-8e3b2367-156f-48c4-b138-0ee267d35b16 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:11.734749 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8e3b2367-156f-48c4-b138-0ee267d35b16 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:11.735235 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8e3b2367-156f-48c4-b138-0ee267d35b16 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:11.740518 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8e3b2367-156f-48c4-b138-0ee267d35b16 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:11.740997 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8e3b2367-156f-48c4-b138-0ee267d35b16 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:11.877063 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-1a6d6034-c313-48ca-87be-ff69ed37a850 req-882b6c1a-6266-45e1-9834-152fbe524d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7506222-1035-4ee1-a699-9e34c48aebf6", "name": "network-vif-plugged", "status": "completed", "tag": "4f31b9bd-b25a-4f81-a6f5-a3395bf00234"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:24:11.888497 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8e3b2367-156f-48c4-b138-0ee267d35b16 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:11.898935 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-1a6d6034-c313-48ca-87be-ff69ed37a850 req-882b6c1a-6266-45e1-9834-152fbe524d86 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:11.899813 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-1a6d6034-c313-48ca-87be-ff69ed37a850 req-882b6c1a-6266-45e1-9834-152fbe524d86 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:11.921083 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-1a6d6034-c313-48ca-87be-ff69ed37a850 req-882b6c1a-6266-45e1-9834-152fbe524d86 service nova] Creating event network-vif-plugged:4f31b9bd-b25a-4f81-a6f5-a3395bf00234 for instance d7506222-1035-4ee1-a699-9e34c48aebf6 on hv-cinder-83608 Jun 07 14:24:11.927820 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-1a6d6034-c313-48ca-87be-ff69ed37a850 req-882b6c1a-6266-45e1-9834-152fbe524d86 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054441 Jun 07 14:24:11.928746 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 178/365] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:24:11.930515 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-8e3b2367-156f-48c4-b138-0ee267d35b16 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1302 microversion: 2.1 time: 0.211486 Jun 07 14:24:11.935093 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c6806714-c442-4752-93e4-f11652f709ce tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:11.936125 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c6806714-c442-4752-93e4-f11652f709ce tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:11.943769 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c6806714-c442-4752-93e4-f11652f709ce tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:11.944656 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 188/366] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:11 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1302 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:11.952774 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c6806714-c442-4752-93e4-f11652f709ce tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:11.955992 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c6806714-c442-4752-93e4-f11652f709ce tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:11.957437 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c6806714-c442-4752-93e4-f11652f709ce tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:12.144808 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-02e14033-b544-43fd-8b33-58129610b476 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:12.145919 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-02e14033-b544-43fd-8b33-58129610b476 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:12.153190 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-02e14033-b544-43fd-8b33-58129610b476 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:12.153948 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-02e14033-b544-43fd-8b33-58129610b476 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:12.154907 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-02e14033-b544-43fd-8b33-58129610b476 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:12.155697 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-02e14033-b544-43fd-8b33-58129610b476 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:12.710248 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c6806714-c442-4752-93e4-f11652f709ce tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:12.719385 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c6806714-c442-4752-93e4-f11652f709ce tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1260 microversion: 2.1 time: 0.789176 Jun 07 14:24:12.720087 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 179/367] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:11 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1260 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:12.725077 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-02e14033-b544-43fd-8b33-58129610b476 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:12.734000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-02e14033-b544-43fd-8b33-58129610b476 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1313 microversion: 2.1 time: 0.593172 Jun 07 14:24:12.734723 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 189/368] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:12 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1313 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:12.958552 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e845f9ac-e8da-4bc1-b16b-41111ccecdcc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:12.959961 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e845f9ac-e8da-4bc1-b16b-41111ccecdcc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:12.968087 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e845f9ac-e8da-4bc1-b16b-41111ccecdcc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:12.968905 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e845f9ac-e8da-4bc1-b16b-41111ccecdcc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:12.970098 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e845f9ac-e8da-4bc1-b16b-41111ccecdcc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:12.970741 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e845f9ac-e8da-4bc1-b16b-41111ccecdcc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:13.285388 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-a55d3c56-a468-4fcb-8684-a7d5c85daa98 req-f54c10f3-cff2-4dd1-8131-53d218e81ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2714c53-3b93-4d50-9812-e5f0a324b286", "tag": "cd19e240-c912-408d-ac68-5ada3a1dd139"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:24:13.305193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-a55d3c56-a468-4fcb-8684-a7d5c85daa98 req-f54c10f3-cff2-4dd1-8131-53d218e81ac7 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:13.306306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-a55d3c56-a468-4fcb-8684-a7d5c85daa98 req-f54c10f3-cff2-4dd1-8131-53d218e81ac7 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:13.315544 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e845f9ac-e8da-4bc1-b16b-41111ccecdcc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:13.332700 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e845f9ac-e8da-4bc1-b16b-41111ccecdcc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1369 microversion: 2.1 time: 0.389348 Jun 07 14:24:13.353126 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-a55d3c56-a468-4fcb-8684-a7d5c85daa98 req-f54c10f3-cff2-4dd1-8131-53d218e81ac7 service nova] Creating event network-changed:cd19e240-c912-408d-ac68-5ada3a1dd139 for instance e2714c53-3b93-4d50-9812-e5f0a324b286 on hv-cinder-83608 Jun 07 14:24:13.359354 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 180/369] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:12 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1369 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:13.360527 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-a55d3c56-a468-4fcb-8684-a7d5c85daa98 req-f54c10f3-cff2-4dd1-8131-53d218e81ac7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080728 Jun 07 14:24:13.370887 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 190/370] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:24:13.540255 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-a550e630-dd64-4dc2-8f6e-8f05fde88fda req-3a4b5182-2a67-41f7-8f55-b2072a37999a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2740b69b-07ea-4b16-ae3d-3b964bc65edd", "tag": "44ff486f-5bc3-4d1b-9ece-149684ef12b7"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:24:13.561790 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-a550e630-dd64-4dc2-8f6e-8f05fde88fda req-3a4b5182-2a67-41f7-8f55-b2072a37999a service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:13.562669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-a550e630-dd64-4dc2-8f6e-8f05fde88fda req-3a4b5182-2a67-41f7-8f55-b2072a37999a service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:13.576853 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:13.579945 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-a550e630-dd64-4dc2-8f6e-8f05fde88fda req-3a4b5182-2a67-41f7-8f55-b2072a37999a service nova] Creating event network-changed:44ff486f-5bc3-4d1b-9ece-149684ef12b7 for instance 2740b69b-07ea-4b16-ae3d-3b964bc65edd on hv-cinder-83608 Jun 07 14:24:13.587704 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-a550e630-dd64-4dc2-8f6e-8f05fde88fda req-3a4b5182-2a67-41f7-8f55-b2072a37999a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050701 Jun 07 14:24:13.589400 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 181/371] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:24:13.738940 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-14e9801b-107d-45f9-99a4-bc353814805c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:13.739678 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-14e9801b-107d-45f9-99a4-bc353814805c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:13.748064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-14e9801b-107d-45f9-99a4-bc353814805c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:13.748596 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-14e9801b-107d-45f9-99a4-bc353814805c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:13.749579 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-14e9801b-107d-45f9-99a4-bc353814805c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:13.750054 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-14e9801b-107d-45f9-99a4-bc353814805c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:13.754344 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-55450205-85b4-4d7b-b987-fe036b1b0924 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:13.755374 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-55450205-85b4-4d7b-b987-fe036b1b0924 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:13.762829 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-55450205-85b4-4d7b-b987-fe036b1b0924 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:13.763721 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-55450205-85b4-4d7b-b987-fe036b1b0924 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:13.764614 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-55450205-85b4-4d7b-b987-fe036b1b0924 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:13.765154 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-55450205-85b4-4d7b-b987-fe036b1b0924 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:14.085439 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-14e9801b-107d-45f9-99a4-bc353814805c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:14.094049 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-55450205-85b4-4d7b-b987-fe036b1b0924 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:14.095166 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-14e9801b-107d-45f9-99a4-bc353814805c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1260 microversion: 2.1 time: 0.361161 Jun 07 14:24:14.101797 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 191/372] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:13 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1260 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:14.117988 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-55450205-85b4-4d7b-b987-fe036b1b0924 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1313 microversion: 2.1 time: 0.369149 Jun 07 14:24:14.118998 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 182/373] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:13 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:14.357874 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-1810a334-6cc2-4994-b86c-883722517ae4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:14.358491 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-1810a334-6cc2-4994-b86c-883722517ae4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:14.364740 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1810a334-6cc2-4994-b86c-883722517ae4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:14.365201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1810a334-6cc2-4994-b86c-883722517ae4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:14.366000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1810a334-6cc2-4994-b86c-883722517ae4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:14.366441 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1810a334-6cc2-4994-b86c-883722517ae4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:14.503478 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-1810a334-6cc2-4994-b86c-883722517ae4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:14.512193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-1810a334-6cc2-4994-b86c-883722517ae4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1369 microversion: 2.1 time: 0.158237 Jun 07 14:24:14.513188 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 192/374] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:14 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:15.115805 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2e4c7521-afbe-44b4-8a66-1bfdf3612601 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:15.117988 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2e4c7521-afbe-44b4-8a66-1bfdf3612601 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:15.126684 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2e4c7521-afbe-44b4-8a66-1bfdf3612601 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:15.127146 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2e4c7521-afbe-44b4-8a66-1bfdf3612601 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:15.128536 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2e4c7521-afbe-44b4-8a66-1bfdf3612601 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:15.129572 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2e4c7521-afbe-44b4-8a66-1bfdf3612601 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:15.138835 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-2e9820d7-e9b7-4f20-bb86-d8d994a9d8a8 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:15.141870 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-2e9820d7-e9b7-4f20-bb86-d8d994a9d8a8 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:15.153349 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2e9820d7-e9b7-4f20-bb86-d8d994a9d8a8 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:15.153805 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2e9820d7-e9b7-4f20-bb86-d8d994a9d8a8 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:15.154596 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2e9820d7-e9b7-4f20-bb86-d8d994a9d8a8 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:15.155100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2e9820d7-e9b7-4f20-bb86-d8d994a9d8a8 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:15.474273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-2e9820d7-e9b7-4f20-bb86-d8d994a9d8a8 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:15.474793 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2e4c7521-afbe-44b4-8a66-1bfdf3612601 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:15.482674 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-2e9820d7-e9b7-4f20-bb86-d8d994a9d8a8 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1498 microversion: 2.1 time: 0.349295 Jun 07 14:24:15.483269 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 193/375] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:15 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1498 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:15.484107 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2e4c7521-afbe-44b4-8a66-1bfdf3612601 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1260 microversion: 2.1 time: 0.374964 Jun 07 14:24:15.484780 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 183/376] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:15 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1260 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:15.529746 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-b175fd8d-9cc8-468b-b2b0-2f4503e7302f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:15.530543 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-b175fd8d-9cc8-468b-b2b0-2f4503e7302f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:15.538035 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b175fd8d-9cc8-468b-b2b0-2f4503e7302f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:15.538548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b175fd8d-9cc8-468b-b2b0-2f4503e7302f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:15.539427 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b175fd8d-9cc8-468b-b2b0-2f4503e7302f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:15.539926 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b175fd8d-9cc8-468b-b2b0-2f4503e7302f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:15.676277 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-b175fd8d-9cc8-468b-b2b0-2f4503e7302f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:15.684600 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-b175fd8d-9cc8-468b-b2b0-2f4503e7302f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1369 microversion: 2.1 time: 0.159729 Jun 07 14:24:15.685164 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 194/377] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:15 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:16.150123 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6bd676ba-3eab-4048-8587-a05a6eca0eee tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:16.150680 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-6bd676ba-3eab-4048-8587-a05a6eca0eee tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:16.157995 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6bd676ba-3eab-4048-8587-a05a6eca0eee tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:16.158461 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6bd676ba-3eab-4048-8587-a05a6eca0eee tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:16.159455 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6bd676ba-3eab-4048-8587-a05a6eca0eee tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:16.160091 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6bd676ba-3eab-4048-8587-a05a6eca0eee tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:16.187099 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-6bd676ba-3eab-4048-8587-a05a6eca0eee tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Going to try to terminate instance {{(pid=117564) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:24:16.270772 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6bd676ba-3eab-4048-8587-a05a6eca0eee tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 204 len: 0 microversion: 2.1 time: 0.124160 Jun 07 14:24:16.272766 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 184/378] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:24:16 2022] DELETE /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:24:16.281343 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ac7827c3-ef6c-4d47-8a14-5bb18b2cfb84 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:16.281962 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ac7827c3-ef6c-4d47-8a14-5bb18b2cfb84 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:16.289900 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ac7827c3-ef6c-4d47-8a14-5bb18b2cfb84 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:16.291154 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ac7827c3-ef6c-4d47-8a14-5bb18b2cfb84 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:16.293474 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ac7827c3-ef6c-4d47-8a14-5bb18b2cfb84 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:16.294394 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ac7827c3-ef6c-4d47-8a14-5bb18b2cfb84 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:16.316943 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:16.445187 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ac7827c3-ef6c-4d47-8a14-5bb18b2cfb84 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:16.453059 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ac7827c3-ef6c-4d47-8a14-5bb18b2cfb84 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1504 microversion: 2.1 time: 0.175829 Jun 07 14:24:16.453628 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 195/379] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:16 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:16.501366 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1e7a8df8-2e62-4ab1-b025-471a4804c6ff tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:16.502066 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1e7a8df8-2e62-4ab1-b025-471a4804c6ff tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:16.508047 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1e7a8df8-2e62-4ab1-b025-471a4804c6ff tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:16.508496 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1e7a8df8-2e62-4ab1-b025-471a4804c6ff tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:16.509258 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1e7a8df8-2e62-4ab1-b025-471a4804c6ff tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:16.509695 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1e7a8df8-2e62-4ab1-b025-471a4804c6ff tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:16.639780 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1e7a8df8-2e62-4ab1-b025-471a4804c6ff tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:16.647349 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1e7a8df8-2e62-4ab1-b025-471a4804c6ff tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1260 microversion: 2.1 time: 0.150113 Jun 07 14:24:16.647915 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 185/380] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:16 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:16.702234 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-1b932db1-9623-4cfa-b6a1-23e8a4e77b31 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:16.702854 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-1b932db1-9623-4cfa-b6a1-23e8a4e77b31 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:16.709211 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1b932db1-9623-4cfa-b6a1-23e8a4e77b31 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:16.709661 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1b932db1-9623-4cfa-b6a1-23e8a4e77b31 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:16.710430 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1b932db1-9623-4cfa-b6a1-23e8a4e77b31 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:16.710865 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1b932db1-9623-4cfa-b6a1-23e8a4e77b31 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:16.838781 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-1b932db1-9623-4cfa-b6a1-23e8a4e77b31 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:16.846287 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-1b932db1-9623-4cfa-b6a1-23e8a4e77b31 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1369 microversion: 2.1 time: 0.148946 Jun 07 14:24:16.846848 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 196/381] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:16 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:17.470667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-dbc8714a-32b2-47a1-be78-5b4fe84b984e tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:17.471395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-dbc8714a-32b2-47a1-be78-5b4fe84b984e tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:17.478853 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dbc8714a-32b2-47a1-be78-5b4fe84b984e tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:17.479435 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dbc8714a-32b2-47a1-be78-5b4fe84b984e tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:17.480265 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dbc8714a-32b2-47a1-be78-5b4fe84b984e tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:17.480783 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dbc8714a-32b2-47a1-be78-5b4fe84b984e tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:17.632022 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-dbc8714a-32b2-47a1-be78-5b4fe84b984e tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:17.640196 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-dbc8714a-32b2-47a1-be78-5b4fe84b984e tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1504 microversion: 2.1 time: 0.173353 Jun 07 14:24:17.640761 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 186/382] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:17 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:17.664340 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-2f3fb047-5e4f-4719-b497-9d2b192d14f3 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:17.664956 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-2f3fb047-5e4f-4719-b497-9d2b192d14f3 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:17.671011 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2f3fb047-5e4f-4719-b497-9d2b192d14f3 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:17.671513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2f3fb047-5e4f-4719-b497-9d2b192d14f3 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:17.672278 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2f3fb047-5e4f-4719-b497-9d2b192d14f3 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:17.672719 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2f3fb047-5e4f-4719-b497-9d2b192d14f3 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:17.802050 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-2f3fb047-5e4f-4719-b497-9d2b192d14f3 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:17.809999 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-2f3fb047-5e4f-4719-b497-9d2b192d14f3 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1260 microversion: 2.1 time: 0.149393 Jun 07 14:24:17.810560 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 197/383] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:17 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:17.863147 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ab020f63-8e61-4ff2-b650-ef32464d08c8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:17.863784 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ab020f63-8e61-4ff2-b650-ef32464d08c8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:17.869801 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ab020f63-8e61-4ff2-b650-ef32464d08c8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:17.870262 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ab020f63-8e61-4ff2-b650-ef32464d08c8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:17.871024 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ab020f63-8e61-4ff2-b650-ef32464d08c8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:17.871490 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ab020f63-8e61-4ff2-b650-ef32464d08c8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:18.000971 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ab020f63-8e61-4ff2-b650-ef32464d08c8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:18.009283 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ab020f63-8e61-4ff2-b650-ef32464d08c8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1369 microversion: 2.1 time: 0.149897 Jun 07 14:24:18.009869 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 187/384] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:17 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:18.657046 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-2b898398-6cb7-4bc8-8ebc-fcae6f369aa5 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:18.657578 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-2b898398-6cb7-4bc8-8ebc-fcae6f369aa5 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:18.659510 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=2 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:18.664838 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2b898398-6cb7-4bc8-8ebc-fcae6f369aa5 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:18.665393 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2b898398-6cb7-4bc8-8ebc-fcae6f369aa5 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:18.666020 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2b898398-6cb7-4bc8-8ebc-fcae6f369aa5 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:18.666447 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2b898398-6cb7-4bc8-8ebc-fcae6f369aa5 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:18.796096 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-2b898398-6cb7-4bc8-8ebc-fcae6f369aa5 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:18.803408 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-2b898398-6cb7-4bc8-8ebc-fcae6f369aa5 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1504 microversion: 2.1 time: 0.150216 Jun 07 14:24:18.803969 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 198/385] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:18 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:18.826062 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-bf7d4b9c-0ff4-4010-9fd2-e7742e817d17 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:18.826710 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-bf7d4b9c-0ff4-4010-9fd2-e7742e817d17 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:18.833167 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bf7d4b9c-0ff4-4010-9fd2-e7742e817d17 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:18.833619 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bf7d4b9c-0ff4-4010-9fd2-e7742e817d17 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:18.834379 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bf7d4b9c-0ff4-4010-9fd2-e7742e817d17 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:18.834820 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bf7d4b9c-0ff4-4010-9fd2-e7742e817d17 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:18.964380 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-bf7d4b9c-0ff4-4010-9fd2-e7742e817d17 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:18.972884 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-bf7d4b9c-0ff4-4010-9fd2-e7742e817d17 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1260 microversion: 2.1 time: 0.150948 Jun 07 14:24:18.973453 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 188/386] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:18 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:19.025742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-20cfd38c-d11c-48e5-a12d-ef5c05d0a542 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:19.027268 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-20cfd38c-d11c-48e5-a12d-ef5c05d0a542 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:19.033208 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-20cfd38c-d11c-48e5-a12d-ef5c05d0a542 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:19.033650 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-20cfd38c-d11c-48e5-a12d-ef5c05d0a542 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:19.034398 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-20cfd38c-d11c-48e5-a12d-ef5c05d0a542 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:19.034828 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-20cfd38c-d11c-48e5-a12d-ef5c05d0a542 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:19.166260 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-20cfd38c-d11c-48e5-a12d-ef5c05d0a542 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:19.174633 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-20cfd38c-d11c-48e5-a12d-ef5c05d0a542 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1369 microversion: 2.1 time: 0.152716 Jun 07 14:24:19.175212 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 199/387] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:19 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:19.820181 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8d1fd34a-d133-445d-ac81-da77277deabd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:19.820789 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8d1fd34a-d133-445d-ac81-da77277deabd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:19.822714 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=4 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:19.824166 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=18 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:19.830138 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8d1fd34a-d133-445d-ac81-da77277deabd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:19.830721 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8d1fd34a-d133-445d-ac81-da77277deabd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:19.831474 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8d1fd34a-d133-445d-ac81-da77277deabd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:19.831905 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8d1fd34a-d133-445d-ac81-da77277deabd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:19.958871 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8d1fd34a-d133-445d-ac81-da77277deabd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:19.967233 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8d1fd34a-d133-445d-ac81-da77277deabd tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1504 microversion: 2.1 time: 0.150864 Jun 07 14:24:19.967791 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 189/388] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:19 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:19.989414 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-abc636be-b8ea-41a5-82a7-d66dd55c10fa tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:19.990024 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-abc636be-b8ea-41a5-82a7-d66dd55c10fa tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:19.996272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-abc636be-b8ea-41a5-82a7-d66dd55c10fa tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:19.996725 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-abc636be-b8ea-41a5-82a7-d66dd55c10fa tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:19.997489 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-abc636be-b8ea-41a5-82a7-d66dd55c10fa tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:19.997921 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-abc636be-b8ea-41a5-82a7-d66dd55c10fa tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:20.129306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-abc636be-b8ea-41a5-82a7-d66dd55c10fa tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:20.137478 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-abc636be-b8ea-41a5-82a7-d66dd55c10fa tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1260 microversion: 2.1 time: 0.151806 Jun 07 14:24:20.138039 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 200/389] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:19 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:20.190848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-88554de8-75be-46e1-8a11-1a71c627211d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:20.191521 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-88554de8-75be-46e1-8a11-1a71c627211d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:20.197702 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-88554de8-75be-46e1-8a11-1a71c627211d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:20.198842 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-88554de8-75be-46e1-8a11-1a71c627211d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:20.199949 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-88554de8-75be-46e1-8a11-1a71c627211d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:20.200409 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-88554de8-75be-46e1-8a11-1a71c627211d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:20.328738 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-88554de8-75be-46e1-8a11-1a71c627211d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:20.336306 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-88554de8-75be-46e1-8a11-1a71c627211d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1369 microversion: 2.1 time: 0.149325 Jun 07 14:24:20.337080 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 190/390] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:20 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:20.985100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-002b8b5b-7519-49b6-9d28-e4b21d84002d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:20.985710 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-002b8b5b-7519-49b6-9d28-e4b21d84002d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:20.993201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-002b8b5b-7519-49b6-9d28-e4b21d84002d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:20.993811 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-002b8b5b-7519-49b6-9d28-e4b21d84002d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:20.995605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-002b8b5b-7519-49b6-9d28-e4b21d84002d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:20.996268 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-002b8b5b-7519-49b6-9d28-e4b21d84002d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:21.126871 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-002b8b5b-7519-49b6-9d28-e4b21d84002d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:21.134443 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-002b8b5b-7519-49b6-9d28-e4b21d84002d tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1504 microversion: 2.1 time: 0.153170 Jun 07 14:24:21.135016 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 201/391] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:20 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:21.154319 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3bb0828b-2f1a-4e50-a8aa-93a2686e1a42 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:21.154942 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3bb0828b-2f1a-4e50-a8aa-93a2686e1a42 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:21.161506 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3bb0828b-2f1a-4e50-a8aa-93a2686e1a42 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:21.161953 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3bb0828b-2f1a-4e50-a8aa-93a2686e1a42 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:21.162722 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3bb0828b-2f1a-4e50-a8aa-93a2686e1a42 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:21.163159 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3bb0828b-2f1a-4e50-a8aa-93a2686e1a42 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:21.298273 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3bb0828b-2f1a-4e50-a8aa-93a2686e1a42 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:21.305907 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3bb0828b-2f1a-4e50-a8aa-93a2686e1a42 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1260 microversion: 2.1 time: 0.156065 Jun 07 14:24:21.306472 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 191/392] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:21 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:21.353466 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-fc1b7f84-2b70-499b-84ad-e91821c52087 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:21.354675 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-fc1b7f84-2b70-499b-84ad-e91821c52087 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:21.361227 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fc1b7f84-2b70-499b-84ad-e91821c52087 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:21.361784 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fc1b7f84-2b70-499b-84ad-e91821c52087 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:21.362827 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fc1b7f84-2b70-499b-84ad-e91821c52087 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:21.363391 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fc1b7f84-2b70-499b-84ad-e91821c52087 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:21.492059 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-fc1b7f84-2b70-499b-84ad-e91821c52087 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:21.500568 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-fc1b7f84-2b70-499b-84ad-e91821c52087 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1369 microversion: 2.1 time: 0.150970 Jun 07 14:24:21.501066 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 202/393] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:21 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:22.152613 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-73d2d269-5873-454e-90ea-6174ce96ea49 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:22.153232 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-73d2d269-5873-454e-90ea-6174ce96ea49 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:22.160076 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-73d2d269-5873-454e-90ea-6174ce96ea49 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:22.160653 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-73d2d269-5873-454e-90ea-6174ce96ea49 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:22.161279 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-73d2d269-5873-454e-90ea-6174ce96ea49 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:22.161712 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-73d2d269-5873-454e-90ea-6174ce96ea49 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:22.324089 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-14dcf56b-73e2-4e24-a63f-ec1c32d96ab8 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:22.324684 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-14dcf56b-73e2-4e24-a63f-ec1c32d96ab8 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:22.326524 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=98 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:22.331793 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-14dcf56b-73e2-4e24-a63f-ec1c32d96ab8 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:22.332240 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-14dcf56b-73e2-4e24-a63f-ec1c32d96ab8 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:22.333002 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-14dcf56b-73e2-4e24-a63f-ec1c32d96ab8 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:22.333430 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-14dcf56b-73e2-4e24-a63f-ec1c32d96ab8 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:22.355890 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-73d2d269-5873-454e-90ea-6174ce96ea49 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:22.363659 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-73d2d269-5873-454e-90ea-6174ce96ea49 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1504 microversion: 2.1 time: 0.215733 Jun 07 14:24:22.364552 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 192/394] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:22 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:22.495600 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-03e2bf7b-aea3-4328-8ae9-54c048f5c699 req-07d14e4d-afe0-4ec0-b1c3-2ad79a0c0117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7506222-1035-4ee1-a699-9e34c48aebf6", "name": "network-vif-deleted", "tag": "4f31b9bd-b25a-4f81-a6f5-a3395bf00234"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:24:22.504050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-03e2bf7b-aea3-4328-8ae9-54c048f5c699 req-07d14e4d-afe0-4ec0-b1c3-2ad79a0c0117 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:22.504492 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-03e2bf7b-aea3-4328-8ae9-54c048f5c699 req-07d14e4d-afe0-4ec0-b1c3-2ad79a0c0117 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:22.516601 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-03e2bf7b-aea3-4328-8ae9-54c048f5c699 req-07d14e4d-afe0-4ec0-b1c3-2ad79a0c0117 service nova] Creating event network-vif-deleted:4f31b9bd-b25a-4f81-a6f5-a3395bf00234 for instance d7506222-1035-4ee1-a699-9e34c48aebf6 on hv-cinder-83608 Jun 07 14:24:22.521594 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-03e2bf7b-aea3-4328-8ae9-54c048f5c699 req-07d14e4d-afe0-4ec0-b1c3-2ad79a0c0117 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030420 Jun 07 14:24:22.522184 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 193/395] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:24:22.527466 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-768baeaa-85ed-4781-a3d0-ddd55ca32f80 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:22.528156 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-768baeaa-85ed-4781-a3d0-ddd55ca32f80 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:22.534369 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-768baeaa-85ed-4781-a3d0-ddd55ca32f80 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:22.534798 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-768baeaa-85ed-4781-a3d0-ddd55ca32f80 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:22.535586 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-768baeaa-85ed-4781-a3d0-ddd55ca32f80 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:22.536019 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-768baeaa-85ed-4781-a3d0-ddd55ca32f80 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:22.542104 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-14dcf56b-73e2-4e24-a63f-ec1c32d96ab8 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:22.549379 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-14dcf56b-73e2-4e24-a63f-ec1c32d96ab8 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1260 microversion: 2.1 time: 0.229868 Jun 07 14:24:22.549946 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 203/396] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:22 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1260 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:22.668189 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-768baeaa-85ed-4781-a3d0-ddd55ca32f80 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:22.676786 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-768baeaa-85ed-4781-a3d0-ddd55ca32f80 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1369 microversion: 2.1 time: 0.153507 Jun 07 14:24:22.677351 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 194/397] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:22 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:23.381535 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-2f484af6-dcc2-4a40-bae5-bf6ecaf6c490 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:23.382153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-2f484af6-dcc2-4a40-bae5-bf6ecaf6c490 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:23.388775 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2f484af6-dcc2-4a40-bae5-bf6ecaf6c490 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:23.389228 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2f484af6-dcc2-4a40-bae5-bf6ecaf6c490 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:23.389990 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2f484af6-dcc2-4a40-bae5-bf6ecaf6c490 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:23.390424 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2f484af6-dcc2-4a40-bae5-bf6ecaf6c490 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:23.453625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-2f484af6-dcc2-4a40-bae5-bf6ecaf6c490 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:23.460983 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-2f484af6-dcc2-4a40-bae5-bf6ecaf6c490 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1462 microversion: 2.1 time: 0.083279 Jun 07 14:24:23.461546 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 204/398] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:23 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1462 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:23.566442 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-402893c6-7727-4aea-af57-33a304de2f51 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:23.567051 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-402893c6-7727-4aea-af57-33a304de2f51 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:23.573731 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-402893c6-7727-4aea-af57-33a304de2f51 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:23.574175 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-402893c6-7727-4aea-af57-33a304de2f51 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:23.574934 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-402893c6-7727-4aea-af57-33a304de2f51 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:23.575400 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-402893c6-7727-4aea-af57-33a304de2f51 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:23.693899 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-43e250d9-6660-43e3-88bf-749a01f5c05e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:23.694618 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-43e250d9-6660-43e3-88bf-749a01f5c05e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:23.701212 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-43e250d9-6660-43e3-88bf-749a01f5c05e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:23.701671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-43e250d9-6660-43e3-88bf-749a01f5c05e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:23.702493 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-43e250d9-6660-43e3-88bf-749a01f5c05e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:23.703016 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-43e250d9-6660-43e3-88bf-749a01f5c05e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:23.708192 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-402893c6-7727-4aea-af57-33a304de2f51 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:23.717884 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-402893c6-7727-4aea-af57-33a304de2f51 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1260 microversion: 2.1 time: 0.155265 Jun 07 14:24:23.718461 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 195/399] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:23 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:23.831286 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-43e250d9-6660-43e3-88bf-749a01f5c05e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:23.839250 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-43e250d9-6660-43e3-88bf-749a01f5c05e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1369 microversion: 2.1 time: 0.149176 Jun 07 14:24:23.839825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 205/400] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:23 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:24.478105 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-612c56d4-cbe4-41e2-9ce4-8583a75e75a7 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:24.478721 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-612c56d4-cbe4-41e2-9ce4-8583a75e75a7 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:24.485044 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-612c56d4-cbe4-41e2-9ce4-8583a75e75a7 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:24.485486 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-612c56d4-cbe4-41e2-9ce4-8583a75e75a7 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:24.486243 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-612c56d4-cbe4-41e2-9ce4-8583a75e75a7 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:24.486676 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-612c56d4-cbe4-41e2-9ce4-8583a75e75a7 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:24.552857 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-612c56d4-cbe4-41e2-9ce4-8583a75e75a7 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:24.560416 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-612c56d4-cbe4-41e2-9ce4-8583a75e75a7 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1462 microversion: 2.1 time: 0.086211 Jun 07 14:24:24.560983 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 196/401] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:24 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1462 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:24.735110 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-26bc66fb-6e45-46c2-9335-60b1e68fd698 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:24.735683 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-26bc66fb-6e45-46c2-9335-60b1e68fd698 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:24.741732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-26bc66fb-6e45-46c2-9335-60b1e68fd698 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:24.742186 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-26bc66fb-6e45-46c2-9335-60b1e68fd698 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:24.742943 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-26bc66fb-6e45-46c2-9335-60b1e68fd698 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:24.743419 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-26bc66fb-6e45-46c2-9335-60b1e68fd698 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:24.856497 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-13354280-f4ee-4238-b0b1-03596d009772 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:24.857209 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-13354280-f4ee-4238-b0b1-03596d009772 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:24.863623 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-13354280-f4ee-4238-b0b1-03596d009772 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:24.864082 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-13354280-f4ee-4238-b0b1-03596d009772 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:24.864850 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-13354280-f4ee-4238-b0b1-03596d009772 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:24.865287 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-13354280-f4ee-4238-b0b1-03596d009772 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:24.874606 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-26bc66fb-6e45-46c2-9335-60b1e68fd698 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:24.881914 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:24.882413 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-26bc66fb-6e45-46c2-9335-60b1e68fd698 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1260 microversion: 2.1 time: 0.150846 Jun 07 14:24:24.883192 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 206/402] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:24 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:25.001690 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-13354280-f4ee-4238-b0b1-03596d009772 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:25.010740 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-13354280-f4ee-4238-b0b1-03596d009772 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1369 microversion: 2.1 time: 0.158222 Jun 07 14:24:25.011332 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 197/403] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:24 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:25.578132 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-17dc46a6-a7a8-408c-948f-88519d1b44aa tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:25.578776 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-17dc46a6-a7a8-408c-948f-88519d1b44aa tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:25.584909 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-17dc46a6-a7a8-408c-948f-88519d1b44aa tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:25.585559 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-17dc46a6-a7a8-408c-948f-88519d1b44aa tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:25.586366 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-17dc46a6-a7a8-408c-948f-88519d1b44aa tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:25.586914 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-17dc46a6-a7a8-408c-948f-88519d1b44aa tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:25.618546 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-17dc46a6-a7a8-408c-948f-88519d1b44aa tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:25.618994 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-17dc46a6-a7a8-408c-948f-88519d1b44aa tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:25.620013 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.objects.instance [None req-17dc46a6-a7a8-408c-948f-88519d1b44aa tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lazy-loading 'fault' on Instance uuid d7506222-1035-4ee1-a699-9e34c48aebf6 {{(pid=117565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:24:25.687169 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-17dc46a6-a7a8-408c-948f-88519d1b44aa tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becdcd1df4a641e6a5bda05220f7aa07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb2b7cbdaf9495480fc881e823c1913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:25.695522 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-17dc46a6-a7a8-408c-948f-88519d1b44aa tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 200 len: 1303 microversion: 2.1 time: 0.121310 Jun 07 14:24:25.696364 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 207/404] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:25 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 1303 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:25.824713 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-73476591-8a35-4d35-9ce9-e9d8d6e592e4 req-aeac5d04-c0f1-498a-9f09-6afe8c06efce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2740b69b-07ea-4b16-ae3d-3b964bc65edd", "name": "network-vif-plugged", "status": "completed", "tag": "44ff486f-5bc3-4d1b-9ece-149684ef12b7"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:24:25.833844 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-73476591-8a35-4d35-9ce9-e9d8d6e592e4 req-aeac5d04-c0f1-498a-9f09-6afe8c06efce service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:25.834277 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-73476591-8a35-4d35-9ce9-e9d8d6e592e4 req-aeac5d04-c0f1-498a-9f09-6afe8c06efce service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:25.845615 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-73476591-8a35-4d35-9ce9-e9d8d6e592e4 req-aeac5d04-c0f1-498a-9f09-6afe8c06efce service nova] Creating event network-vif-plugged:44ff486f-5bc3-4d1b-9ece-149684ef12b7 for instance 2740b69b-07ea-4b16-ae3d-3b964bc65edd on hv-cinder-83608 Jun 07 14:24:25.850919 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-73476591-8a35-4d35-9ce9-e9d8d6e592e4 req-aeac5d04-c0f1-498a-9f09-6afe8c06efce service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030005 Jun 07 14:24:25.851546 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 198/405] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:24:25.899477 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-cf31d06c-f3d4-4291-8c08-75acf6589e10 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:25.900096 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-cf31d06c-f3d4-4291-8c08-75acf6589e10 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:25.906461 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cf31d06c-f3d4-4291-8c08-75acf6589e10 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:25.907032 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cf31d06c-f3d4-4291-8c08-75acf6589e10 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:25.907923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cf31d06c-f3d4-4291-8c08-75acf6589e10 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:25.908428 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cf31d06c-f3d4-4291-8c08-75acf6589e10 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:26.035516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-916505ca-6d56-4207-a756-9f33372c3fc2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:26.036924 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-916505ca-6d56-4207-a756-9f33372c3fc2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:26.087323 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-916505ca-6d56-4207-a756-9f33372c3fc2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:26.090251 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-916505ca-6d56-4207-a756-9f33372c3fc2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:26.093533 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-cf31d06c-f3d4-4291-8c08-75acf6589e10 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:26.095405 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-916505ca-6d56-4207-a756-9f33372c3fc2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:26.096516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-916505ca-6d56-4207-a756-9f33372c3fc2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:26.105310 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-cf31d06c-f3d4-4291-8c08-75acf6589e10 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1260 microversion: 2.1 time: 0.209641 Jun 07 14:24:26.105881 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 208/406] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:25 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:26.479516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-916505ca-6d56-4207-a756-9f33372c3fc2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:26.487008 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-916505ca-6d56-4207-a756-9f33372c3fc2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1369 microversion: 2.1 time: 0.463205 Jun 07 14:24:26.487600 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 199/407] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:26 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1369 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:26.712332 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-2e7ba620-06b5-4c4f-bdb2-521cb387dd17 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:26.712941 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-2e7ba620-06b5-4c4f-bdb2-521cb387dd17 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] [instance: d7506222-1035-4ee1-a699-9e34c48aebf6] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:26.719262 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2e7ba620-06b5-4c4f-bdb2-521cb387dd17 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:26.719706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2e7ba620-06b5-4c4f-bdb2-521cb387dd17 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:26.720457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2e7ba620-06b5-4c4f-bdb2-521cb387dd17 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:26.720891 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2e7ba620-06b5-4c4f-bdb2-521cb387dd17 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:26.735139 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-2e7ba620-06b5-4c4f-bdb2-521cb387dd17 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] HTTP exception thrown: Instance d7506222-1035-4ee1-a699-9e34c48aebf6 could not be found. Jun 07 14:24:26.736792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-2e7ba620-06b5-4c4f-bdb2-521cb387dd17 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Request method failure captured: Jun 07 14:24:26.736792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 HTTP/1.1 Jun 07 14:24:26.736792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:24:26.736792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:24:26.736792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:24:26.736792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:24:26.736792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:24:26.736792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:24:26.736792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:24:26.736792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:24:26.736792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin19PUI20ECdnE3AWzXfl0EbVHP3vT8kFaBWtD5Q9HBfcXfI468y0xXcwxPNP-KpfFWVExuERoYd05U0Xai80T-MVJr15ydAvT2caurNxVEcqbiHqnMb_5pw2heyETPR3flKUMDCrV13GiCXBl8mHmLArV3-zq2u_mJEreKNTRZEfhG8 Jun 07 14:24:26.736792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:24:26.736792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:24:26.736792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:24:26.736792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:24:26.736792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:24:26.736792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:24:26.736792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: ecb2b7cbdaf9495480fc881e823c1913 Jun 07 14:24:26.736792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-VolumesActionsTest-1059601317 Jun 07 14:24:26.736792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:24:26.736792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:24:26.738309 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ecb2b7cbdaf9495480fc881e823c1913"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ecb2b7cbdaf9495480fc881e823c1913", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ecb2b7cbdaf9495480fc881e823c1913"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ecb2b7cbdaf9495480fc881e823c1913"}]}] Jun 07 14:24:26.738309 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-VolumesActionsTest-1059601317 Jun 07 14:24:26.738309 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: ecb2b7cbdaf9495480fc881e823c1913 Jun 07 14:24:26.738309 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-VolumesActionsTest-1059601317 Jun 07 14:24:26.738309 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-VolumesActionsTest-1059601317-project Jun 07 14:24:26.738309 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:24:26.738309 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:24:26.738309 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: becdcd1df4a641e6a5bda05220f7aa07 Jun 07 14:24:26.738309 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-VolumesActionsTest-1059601317-project Jun 07 14:24:26.738309 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:24:26.738309 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance d7506222-1035-4ee1-a699-9e34c48aebf6 could not be found. Jun 07 14:24:26.738309 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': 'd7506222-1035-4ee1-a699-9e34c48aebf6'} Jun 07 14:24:26.739335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:24:26.739335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:24:26.739335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:24:26.739335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:24:26.739335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:24:26.739335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:24:26.739335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:24:26.739335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:24:26.739335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:24:26.739335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:24:26.739335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7506222-1035-4ee1-a699-9e34c48aebf6 could not be found. Jun 07 14:24:26.739335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:24:26.739335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:24:26.739335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:24:26.739335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:24:26.739335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:24:26.739335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:24:26.739335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:24:26.739335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:24:26.739335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:24:26.740814 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:24:26.740814 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:24:26.740814 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:24:26.740814 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:24:26.740814 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:24:26.740814 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:24:26.740814 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:24:26.740814 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7506222-1035-4ee1-a699-9e34c48aebf6 could not be found. Jun 07 14:24:26.740814 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:24:26.740814 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:24:26.740814 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:24:26.740814 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:24:26.740814 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:24:26.740814 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:24:26.740814 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:24:26.740814 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:24:26.740814 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7506222-1035-4ee1-a699-9e34c48aebf6 could not be found. Jun 07 14:24:26.740814 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:24:26.742096 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-2e7ba620-06b5-4c4f-bdb2-521cb387dd17 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] Returning 404 to user: Instance d7506222-1035-4ee1-a699-9e34c48aebf6 could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:24:26.742096 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-2e7ba620-06b5-4c4f-bdb2-521cb387dd17 tempest-VolumesActionsTest-1059601317 tempest-VolumesActionsTest-1059601317-project] 10.222.0.81 "GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6" status: 404 len: 111 microversion: 2.1 time: 0.029658 Jun 07 14:24:26.742096 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 209/408] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:26 2022] GET /compute/v2.1/servers/d7506222-1035-4ee1-a699-9e34c48aebf6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:24:26.830712 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-eef492e5-20b6-497c-9a85-a4e9a676268f tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6bb72196-b452-450e-959a-83831a46d81d", "device": "/dev/sdb"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:24:26.830712 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-eef492e5-20b6-497c-9a85-a4e9a676268f tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:26.836120 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eef492e5-20b6-497c-9a85-a4e9a676268f tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:26.836716 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eef492e5-20b6-497c-9a85-a4e9a676268f tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:26.837485 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eef492e5-20b6-497c-9a85-a4e9a676268f tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:26.837924 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eef492e5-20b6-497c-9a85-a4e9a676268f tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:27.122645 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-63344935-35ea-4a30-adfc-3ab1ff7bc891 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:27.123387 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-63344935-35ea-4a30-adfc-3ab1ff7bc891 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:27.129409 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-63344935-35ea-4a30-adfc-3ab1ff7bc891 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:27.129932 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-63344935-35ea-4a30-adfc-3ab1ff7bc891 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:27.130947 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-63344935-35ea-4a30-adfc-3ab1ff7bc891 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:27.131414 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-63344935-35ea-4a30-adfc-3ab1ff7bc891 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:27.273253 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-63344935-35ea-4a30-adfc-3ab1ff7bc891 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:27.281469 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-63344935-35ea-4a30-adfc-3ab1ff7bc891 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1260 microversion: 2.1 time: 0.163574 Jun 07 14:24:27.282035 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 210/409] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:27 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:27.504058 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-53dbfefd-708e-4f24-b510-ae56fa9b7689 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:27.504671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-53dbfefd-708e-4f24-b510-ae56fa9b7689 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:27.511452 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-53dbfefd-708e-4f24-b510-ae56fa9b7689 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:27.511904 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-53dbfefd-708e-4f24-b510-ae56fa9b7689 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:27.512663 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-53dbfefd-708e-4f24-b510-ae56fa9b7689 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:27.513098 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-53dbfefd-708e-4f24-b510-ae56fa9b7689 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:27.641643 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-53dbfefd-708e-4f24-b510-ae56fa9b7689 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:27.649063 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-53dbfefd-708e-4f24-b510-ae56fa9b7689 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1369 microversion: 2.1 time: 0.148888 Jun 07 14:24:27.649625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 211/410] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:27 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:28.298209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ded70d17-4c28-4c97-bf9c-c34aaaf950b1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:28.298812 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ded70d17-4c28-4c97-bf9c-c34aaaf950b1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:28.304794 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ded70d17-4c28-4c97-bf9c-c34aaaf950b1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:28.305237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ded70d17-4c28-4c97-bf9c-c34aaaf950b1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:28.305987 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ded70d17-4c28-4c97-bf9c-c34aaaf950b1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:28.306419 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ded70d17-4c28-4c97-bf9c-c34aaaf950b1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:28.321487 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=100 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:28.438081 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ded70d17-4c28-4c97-bf9c-c34aaaf950b1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:28.445366 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ded70d17-4c28-4c97-bf9c-c34aaaf950b1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1260 microversion: 2.1 time: 0.151059 Jun 07 14:24:28.445926 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 212/411] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:28 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:28.665831 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-bd2a8a18-0f72-4571-ba98-f240adb68c32 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:28.666999 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-bd2a8a18-0f72-4571-ba98-f240adb68c32 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:28.673221 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bd2a8a18-0f72-4571-ba98-f240adb68c32 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:28.673667 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bd2a8a18-0f72-4571-ba98-f240adb68c32 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:28.674417 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bd2a8a18-0f72-4571-ba98-f240adb68c32 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:28.674848 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bd2a8a18-0f72-4571-ba98-f240adb68c32 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:28.800047 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-bd2a8a18-0f72-4571-ba98-f240adb68c32 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:28.807558 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-bd2a8a18-0f72-4571-ba98-f240adb68c32 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1369 microversion: 2.1 time: 0.145301 Jun 07 14:24:28.808114 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 213/412] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:28 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1369 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:29.461780 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-c1839e64-4ce1-4b88-9ab3-8d44ebb52443 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:29.462411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-c1839e64-4ce1-4b88-9ab3-8d44ebb52443 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:29.469208 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c1839e64-4ce1-4b88-9ab3-8d44ebb52443 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:29.469654 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c1839e64-4ce1-4b88-9ab3-8d44ebb52443 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:29.470404 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c1839e64-4ce1-4b88-9ab3-8d44ebb52443 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:29.470832 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c1839e64-4ce1-4b88-9ab3-8d44ebb52443 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:29.601104 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-c1839e64-4ce1-4b88-9ab3-8d44ebb52443 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:29.608834 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-c1839e64-4ce1-4b88-9ab3-8d44ebb52443 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1260 microversion: 2.1 time: 0.150864 Jun 07 14:24:29.609385 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 214/413] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:29 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:29.824038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-1567c229-f809-4cd5-91fa-972adfe80258 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:29.824574 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-1567c229-f809-4cd5-91fa-972adfe80258 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:29.830424 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1567c229-f809-4cd5-91fa-972adfe80258 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:29.830873 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1567c229-f809-4cd5-91fa-972adfe80258 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:29.831668 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1567c229-f809-4cd5-91fa-972adfe80258 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:29.832103 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1567c229-f809-4cd5-91fa-972adfe80258 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:29.962306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-1567c229-f809-4cd5-91fa-972adfe80258 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:29.969893 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-1567c229-f809-4cd5-91fa-972adfe80258 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1369 microversion: 2.1 time: 0.150156 Jun 07 14:24:29.970461 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 215/414] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:29 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:30.625979 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-1e623d84-53d9-4b63-b81b-20fe4d57630d tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:30.626603 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-1e623d84-53d9-4b63-b81b-20fe4d57630d tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:30.632611 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1e623d84-53d9-4b63-b81b-20fe4d57630d tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:30.633062 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1e623d84-53d9-4b63-b81b-20fe4d57630d tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:30.633818 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1e623d84-53d9-4b63-b81b-20fe4d57630d tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:30.634256 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1e623d84-53d9-4b63-b81b-20fe4d57630d tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:30.761773 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-1e623d84-53d9-4b63-b81b-20fe4d57630d tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:30.769227 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-1e623d84-53d9-4b63-b81b-20fe4d57630d tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1260 microversion: 2.1 time: 0.147092 Jun 07 14:24:30.769787 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 216/415] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:30 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:30.986691 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-c62e2ad2-aa1d-4e58-9461-fc999f2b0669 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:30.987336 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-c62e2ad2-aa1d-4e58-9461-fc999f2b0669 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:30.993414 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c62e2ad2-aa1d-4e58-9461-fc999f2b0669 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:30.993889 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c62e2ad2-aa1d-4e58-9461-fc999f2b0669 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:30.995561 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c62e2ad2-aa1d-4e58-9461-fc999f2b0669 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:30.995999 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c62e2ad2-aa1d-4e58-9461-fc999f2b0669 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:31.126293 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-c62e2ad2-aa1d-4e58-9461-fc999f2b0669 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:31.133552 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-c62e2ad2-aa1d-4e58-9461-fc999f2b0669 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1369 microversion: 2.1 time: 0.150639 Jun 07 14:24:31.134114 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 217/416] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:30 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:31.785508 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-55929b28-8989-4571-b91c-aacc76bd6372 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:31.786122 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-55929b28-8989-4571-b91c-aacc76bd6372 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:31.792948 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-55929b28-8989-4571-b91c-aacc76bd6372 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:31.793401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-55929b28-8989-4571-b91c-aacc76bd6372 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:31.794172 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-55929b28-8989-4571-b91c-aacc76bd6372 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:31.794618 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-55929b28-8989-4571-b91c-aacc76bd6372 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:31.927084 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-55929b28-8989-4571-b91c-aacc76bd6372 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:31.935947 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-55929b28-8989-4571-b91c-aacc76bd6372 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1260 microversion: 2.1 time: 0.153981 Jun 07 14:24:31.936919 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 218/417] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:31 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:32.149794 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ade52d0d-fe73-4b0b-80f2-2eff1bb8ecc7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:32.150333 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ade52d0d-fe73-4b0b-80f2-2eff1bb8ecc7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:32.157007 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ade52d0d-fe73-4b0b-80f2-2eff1bb8ecc7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:32.157460 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ade52d0d-fe73-4b0b-80f2-2eff1bb8ecc7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:32.158230 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ade52d0d-fe73-4b0b-80f2-2eff1bb8ecc7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:32.158670 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ade52d0d-fe73-4b0b-80f2-2eff1bb8ecc7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:32.287417 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ade52d0d-fe73-4b0b-80f2-2eff1bb8ecc7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:32.295594 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ade52d0d-fe73-4b0b-80f2-2eff1bb8ecc7 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1369 microversion: 2.1 time: 0.149660 Jun 07 14:24:32.296154 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 219/418] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:32 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:32.953748 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-869233ce-c5f7-49c5-8c4d-27809d0e138a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:32.954386 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-869233ce-c5f7-49c5-8c4d-27809d0e138a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:32.960255 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-869233ce-c5f7-49c5-8c4d-27809d0e138a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:32.960718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-869233ce-c5f7-49c5-8c4d-27809d0e138a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:32.961448 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-869233ce-c5f7-49c5-8c4d-27809d0e138a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:32.961901 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-869233ce-c5f7-49c5-8c4d-27809d0e138a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:33.091670 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-869233ce-c5f7-49c5-8c4d-27809d0e138a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:33.099933 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-869233ce-c5f7-49c5-8c4d-27809d0e138a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1260 microversion: 2.1 time: 0.150059 Jun 07 14:24:33.100495 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 220/419] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:32 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:33.312039 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-720c8b4e-9e03-4890-98be-b76e4f68341e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:33.312646 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-720c8b4e-9e03-4890-98be-b76e4f68341e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:33.318663 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-720c8b4e-9e03-4890-98be-b76e4f68341e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:33.319107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-720c8b4e-9e03-4890-98be-b76e4f68341e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:33.319880 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-720c8b4e-9e03-4890-98be-b76e4f68341e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:33.320310 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-720c8b4e-9e03-4890-98be-b76e4f68341e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:33.449482 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-720c8b4e-9e03-4890-98be-b76e4f68341e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:33.456681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-720c8b4e-9e03-4890-98be-b76e4f68341e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1369 microversion: 2.1 time: 0.148489 Jun 07 14:24:33.457237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 221/420] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:33 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:34.116858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-a08cdac6-a870-4f5c-9269-08b3b0031471 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:34.117477 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-a08cdac6-a870-4f5c-9269-08b3b0031471 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:34.123958 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a08cdac6-a870-4f5c-9269-08b3b0031471 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:34.124407 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a08cdac6-a870-4f5c-9269-08b3b0031471 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:34.125172 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a08cdac6-a870-4f5c-9269-08b3b0031471 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:34.125638 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a08cdac6-a870-4f5c-9269-08b3b0031471 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:34.266037 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-a08cdac6-a870-4f5c-9269-08b3b0031471 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:34.273619 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-a08cdac6-a870-4f5c-9269-08b3b0031471 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1260 microversion: 2.1 time: 0.160609 Jun 07 14:24:34.274213 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 222/421] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:34 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:34.473914 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-8efb2721-45d3-4de8-a1fc-5599eaa00b21 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:34.474437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-8efb2721-45d3-4de8-a1fc-5599eaa00b21 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:34.480797 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8efb2721-45d3-4de8-a1fc-5599eaa00b21 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:34.481234 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8efb2721-45d3-4de8-a1fc-5599eaa00b21 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:34.481998 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8efb2721-45d3-4de8-a1fc-5599eaa00b21 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:34.482430 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8efb2721-45d3-4de8-a1fc-5599eaa00b21 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:34.624246 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8efb2721-45d3-4de8-a1fc-5599eaa00b21 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:34.639869 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-8efb2721-45d3-4de8-a1fc-5599eaa00b21 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1369 microversion: 2.1 time: 0.170046 Jun 07 14:24:34.642873 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 223/422] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:34 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1369 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:34.729747 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-eef492e5-20b6-497c-9a85-a4e9a676268f tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "POST /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.904160 Jun 07 14:24:34.730344 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 200/423] 10.222.0.81 () {60 vars in 1322 bytes} [Tue Jun 7 14:24:26 2022] POST /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c/os-volume_attachments => generated 194 bytes in 7906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:24:35.291377 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-49928d2b-3371-4a28-9340-ae7779acc450 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:35.291959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-49928d2b-3371-4a28-9340-ae7779acc450 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:35.298020 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-49928d2b-3371-4a28-9340-ae7779acc450 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:35.298482 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-49928d2b-3371-4a28-9340-ae7779acc450 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:35.299274 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-49928d2b-3371-4a28-9340-ae7779acc450 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:35.300035 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-49928d2b-3371-4a28-9340-ae7779acc450 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:35.433693 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-49928d2b-3371-4a28-9340-ae7779acc450 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:35.441037 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-49928d2b-3371-4a28-9340-ae7779acc450 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1260 microversion: 2.1 time: 0.153694 Jun 07 14:24:35.441592 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 224/424] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:35 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:35.657640 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a6ace085-b960-4698-b959-040d8edd636b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:35.658341 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a6ace085-b960-4698-b959-040d8edd636b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:35.665236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a6ace085-b960-4698-b959-040d8edd636b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:35.665693 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a6ace085-b960-4698-b959-040d8edd636b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:35.667065 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a6ace085-b960-4698-b959-040d8edd636b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:35.667533 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a6ace085-b960-4698-b959-040d8edd636b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:35.807288 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a6ace085-b960-4698-b959-040d8edd636b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:35.819511 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a6ace085-b960-4698-b959-040d8edd636b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1369 microversion: 2.1 time: 0.166266 Jun 07 14:24:35.820371 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 201/425] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:35 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:36.002289 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-da976185-c593-431b-bd12-9db8100aaa7d req-c6a53b6f-cbae-4ffa-92a0-b2652a7fdbef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2714c53-3b93-4d50-9812-e5f0a324b286", "name": "network-vif-plugged", "status": "completed", "tag": "cd19e240-c912-408d-ac68-5ada3a1dd139"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:24:36.011531 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-da976185-c593-431b-bd12-9db8100aaa7d req-c6a53b6f-cbae-4ffa-92a0-b2652a7fdbef service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:36.012228 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-da976185-c593-431b-bd12-9db8100aaa7d req-c6a53b6f-cbae-4ffa-92a0-b2652a7fdbef service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:36.024576 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-da976185-c593-431b-bd12-9db8100aaa7d req-c6a53b6f-cbae-4ffa-92a0-b2652a7fdbef service nova] Creating event network-vif-plugged:cd19e240-c912-408d-ac68-5ada3a1dd139 for instance e2714c53-3b93-4d50-9812-e5f0a324b286 on hv-cinder-83608 Jun 07 14:24:36.030068 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-da976185-c593-431b-bd12-9db8100aaa7d req-c6a53b6f-cbae-4ffa-92a0-b2652a7fdbef service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032845 Jun 07 14:24:36.030655 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 225/426] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:24:36.460736 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-48c21587-57ae-4521-b23f-364aadd19708 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:36.461398 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-48c21587-57ae-4521-b23f-364aadd19708 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:36.474898 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-48c21587-57ae-4521-b23f-364aadd19708 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:36.475413 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-48c21587-57ae-4521-b23f-364aadd19708 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:36.476160 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-48c21587-57ae-4521-b23f-364aadd19708 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:36.476682 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-48c21587-57ae-4521-b23f-364aadd19708 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:36.625799 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-48c21587-57ae-4521-b23f-364aadd19708 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:36.635344 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-48c21587-57ae-4521-b23f-364aadd19708 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1260 microversion: 2.1 time: 0.178273 Jun 07 14:24:36.636725 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 202/427] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:36 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:36.837430 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-df933c1f-c075-4ad4-822e-84ff4ddb9244 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:36.838151 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-df933c1f-c075-4ad4-822e-84ff4ddb9244 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:36.844438 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-df933c1f-c075-4ad4-822e-84ff4ddb9244 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:36.844892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-df933c1f-c075-4ad4-822e-84ff4ddb9244 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:36.845872 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-df933c1f-c075-4ad4-822e-84ff4ddb9244 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:36.846313 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-df933c1f-c075-4ad4-822e-84ff4ddb9244 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:37.002938 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-df933c1f-c075-4ad4-822e-84ff4ddb9244 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:37.012510 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-df933c1f-c075-4ad4-822e-84ff4ddb9244 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1562 microversion: 2.1 time: 0.179418 Jun 07 14:24:37.014376 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 226/428] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:36 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1562 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:37.029957 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a014dc2a-03fe-49fb-8406-ab91e6f647fc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:37.030675 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a014dc2a-03fe-49fb-8406-ab91e6f647fc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:37.038028 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a014dc2a-03fe-49fb-8406-ab91e6f647fc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:37.038563 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a014dc2a-03fe-49fb-8406-ab91e6f647fc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:37.039478 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a014dc2a-03fe-49fb-8406-ab91e6f647fc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:37.039985 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a014dc2a-03fe-49fb-8406-ab91e6f647fc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:37.130781 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a014dc2a-03fe-49fb-8406-ab91e6f647fc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105669 Jun 07 14:24:37.131601 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 203/429] 10.222.0.81 () {58 vars in 1274 bytes} [Tue Jun 7 14:24:37 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:24:37.655104 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-dc08d6b7-9d0d-4dae-a523-17028b60bcf5 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:37.655812 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-dc08d6b7-9d0d-4dae-a523-17028b60bcf5 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:37.662430 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-dc08d6b7-9d0d-4dae-a523-17028b60bcf5 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:37.662869 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-dc08d6b7-9d0d-4dae-a523-17028b60bcf5 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:37.663654 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-dc08d6b7-9d0d-4dae-a523-17028b60bcf5 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:37.664210 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-dc08d6b7-9d0d-4dae-a523-17028b60bcf5 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:37.833168 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-dc08d6b7-9d0d-4dae-a523-17028b60bcf5 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:37.844532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-dc08d6b7-9d0d-4dae-a523-17028b60bcf5 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1260 microversion: 2.1 time: 0.195112 Jun 07 14:24:37.847679 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 227/430] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:37 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:38.383066 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-afc84fb9-7876-4b81-8fd8-d4617585e939 req-c1d877db-dc2d-45ed-ac37-f29a41334634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2740b69b-07ea-4b16-ae3d-3b964bc65edd", "tag": "44ff486f-5bc3-4d1b-9ece-149684ef12b7"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:24:38.416430 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-afc84fb9-7876-4b81-8fd8-d4617585e939 req-c1d877db-dc2d-45ed-ac37-f29a41334634 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:38.417212 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-afc84fb9-7876-4b81-8fd8-d4617585e939 req-c1d877db-dc2d-45ed-ac37-f29a41334634 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:38.437612 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-afc84fb9-7876-4b81-8fd8-d4617585e939 req-c1d877db-dc2d-45ed-ac37-f29a41334634 service nova] Creating event network-changed:44ff486f-5bc3-4d1b-9ece-149684ef12b7 for instance 2740b69b-07ea-4b16-ae3d-3b964bc65edd on hv-cinder-83608 Jun 07 14:24:38.445151 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-afc84fb9-7876-4b81-8fd8-d4617585e939 req-c1d877db-dc2d-45ed-ac37-f29a41334634 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065724 Jun 07 14:24:38.446370 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 204/431] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:24:38.864942 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-2fd7e9f6-7c40-4d44-a89c-ae74f8b249d1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:38.866996 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-2fd7e9f6-7c40-4d44-a89c-ae74f8b249d1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:38.881509 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2fd7e9f6-7c40-4d44-a89c-ae74f8b249d1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:38.886240 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2fd7e9f6-7c40-4d44-a89c-ae74f8b249d1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:38.887501 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2fd7e9f6-7c40-4d44-a89c-ae74f8b249d1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:38.888102 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2fd7e9f6-7c40-4d44-a89c-ae74f8b249d1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:39.106869 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-2fd7e9f6-7c40-4d44-a89c-ae74f8b249d1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:39.120280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-2fd7e9f6-7c40-4d44-a89c-ae74f8b249d1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1260 microversion: 2.1 time: 0.262038 Jun 07 14:24:39.138551 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 228/432] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:38 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1260 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:40.139564 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-28322c3e-31d8-407c-872c-d01c4c271424 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:40.140909 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-28322c3e-31d8-407c-872c-d01c4c271424 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:40.143741 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:40.159913 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-28322c3e-31d8-407c-872c-d01c4c271424 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:40.160371 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-28322c3e-31d8-407c-872c-d01c4c271424 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:40.161163 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-28322c3e-31d8-407c-872c-d01c4c271424 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:40.162071 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-28322c3e-31d8-407c-872c-d01c4c271424 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:40.326820 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-28322c3e-31d8-407c-872c-d01c4c271424 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:40.342882 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-28322c3e-31d8-407c-872c-d01c4c271424 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1445 microversion: 2.1 time: 0.207060 Jun 07 14:24:40.344707 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 205/433] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:40 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1445 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:24:40.365029 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-be847234-a1fa-4c3a-83ab-eb2891546aa8 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:24:40.365690 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-be847234-a1fa-4c3a-83ab-eb2891546aa8 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:24:40.376248 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-be847234-a1fa-4c3a-83ab-eb2891546aa8 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:40.376807 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-be847234-a1fa-4c3a-83ab-eb2891546aa8 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:40.377670 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-be847234-a1fa-4c3a-83ab-eb2891546aa8 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:40.378108 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-be847234-a1fa-4c3a-83ab-eb2891546aa8 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:40.580426 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-be847234-a1fa-4c3a-83ab-eb2891546aa8 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:24:40.582833 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=100 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:40.595914 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-be847234-a1fa-4c3a-83ab-eb2891546aa8 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1445 microversion: 2.1 time: 0.237337 Jun 07 14:24:40.596811 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 229/434] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:24:40 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1445 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:24:43.073426 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-4fefb0c4-53d6-48ad-b4cf-2a9082ffba1c req-8025a7e7-57c7-46ab-9bd0-c8f698e72c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2714c53-3b93-4d50-9812-e5f0a324b286", "tag": "cd19e240-c912-408d-ac68-5ada3a1dd139"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:24:43.090271 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-4fefb0c4-53d6-48ad-b4cf-2a9082ffba1c req-8025a7e7-57c7-46ab-9bd0-c8f698e72c82 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:24:43.090762 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-4fefb0c4-53d6-48ad-b4cf-2a9082ffba1c req-8025a7e7-57c7-46ab-9bd0-c8f698e72c82 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:24:43.107484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-4fefb0c4-53d6-48ad-b4cf-2a9082ffba1c req-8025a7e7-57c7-46ab-9bd0-c8f698e72c82 service nova] Creating event network-changed:cd19e240-c912-408d-ac68-5ada3a1dd139 for instance e2714c53-3b93-4d50-9812-e5f0a324b286 on hv-cinder-83608 Jun 07 14:24:43.114235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-4fefb0c4-53d6-48ad-b4cf-2a9082ffba1c req-8025a7e7-57c7-46ab-9bd0-c8f698e72c82 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045769 Jun 07 14:24:43.116002 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 206/435] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:25:01.910733 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-0c09d5b8-7c85-4017-a35f-6d0087c028b7 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:01.911242 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-0c09d5b8-7c85-4017-a35f-6d0087c028b7 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:01.913501 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=55 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:01.918868 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0c09d5b8-7c85-4017-a35f-6d0087c028b7 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:01.919344 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0c09d5b8-7c85-4017-a35f-6d0087c028b7 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:01.920114 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0c09d5b8-7c85-4017-a35f-6d0087c028b7 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:01.920552 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0c09d5b8-7c85-4017-a35f-6d0087c028b7 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:02.046271 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.objects.instance [None req-0c09d5b8-7c85-4017-a35f-6d0087c028b7 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lazy-loading 'services' on Instance uuid 2dc684fd-368e-45b1-b487-b39a2552b70c {{(pid=117565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:25:02.162850 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-0c09d5b8-7c85-4017-a35f-6d0087c028b7 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "DELETE /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c/os-volume_attachments/6bb72196-b452-450e-959a-83831a46d81d" status: 202 len: 0 microversion: 2.1 time: 0.256004 Jun 07 14:25:02.163676 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 230/436] 10.222.0.81 () {58 vars in 1415 bytes} [Tue Jun 7 14:25:01 2022] DELETE /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c/os-volume_attachments/6bb72196-b452-450e-959a-83831a46d81d => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:25:03.275649 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=3 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:03.276397 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:03.280449 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3891e217-5f77-46c9-932b-b341d638b385 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:03.281041 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3891e217-5f77-46c9-932b-b341d638b385 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:03.288286 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3891e217-5f77-46c9-932b-b341d638b385 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:03.288740 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3891e217-5f77-46c9-932b-b341d638b385 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:03.289510 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3891e217-5f77-46c9-932b-b341d638b385 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:03.290485 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3891e217-5f77-46c9-932b-b341d638b385 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:03.315922 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3891e217-5f77-46c9-932b-b341d638b385 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] Going to try to terminate instance {{(pid=117564) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:25:03.389810 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3891e217-5f77-46c9-932b-b341d638b385 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "DELETE /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c" status: 204 len: 0 microversion: 2.1 time: 0.115452 Jun 07 14:25:03.390403 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 207/437] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:25:03 2022] DELETE /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:25:03.399445 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-76a22f27-f955-4386-a74f-f77174ca2f57 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:03.400053 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-76a22f27-f955-4386-a74f-f77174ca2f57 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:03.410559 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-76a22f27-f955-4386-a74f-f77174ca2f57 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:03.411213 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-76a22f27-f955-4386-a74f-f77174ca2f57 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:03.412011 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-76a22f27-f955-4386-a74f-f77174ca2f57 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:03.412444 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-76a22f27-f955-4386-a74f-f77174ca2f57 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:03.549852 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-76a22f27-f955-4386-a74f-f77174ca2f57 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:03.557362 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-76a22f27-f955-4386-a74f-f77174ca2f57 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c" status: 200 len: 1513 microversion: 2.1 time: 0.162365 Jun 07 14:25:03.558125 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 231/438] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:03 2022] GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:04.575851 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3bc167e2-e863-47a2-8ba7-80a1611c9df9 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:04.576570 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3bc167e2-e863-47a2-8ba7-80a1611c9df9 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:04.583043 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3bc167e2-e863-47a2-8ba7-80a1611c9df9 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:04.583536 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3bc167e2-e863-47a2-8ba7-80a1611c9df9 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:04.584297 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3bc167e2-e863-47a2-8ba7-80a1611c9df9 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:04.584735 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3bc167e2-e863-47a2-8ba7-80a1611c9df9 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:04.714460 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3bc167e2-e863-47a2-8ba7-80a1611c9df9 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:04.722529 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3bc167e2-e863-47a2-8ba7-80a1611c9df9 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c" status: 200 len: 1513 microversion: 2.1 time: 0.151333 Jun 07 14:25:04.723206 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 208/439] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:04 2022] GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:05.739815 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-f35fe56a-851c-4659-9d18-56a88d109894 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:05.740890 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-f35fe56a-851c-4659-9d18-56a88d109894 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:05.747501 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f35fe56a-851c-4659-9d18-56a88d109894 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:05.747962 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f35fe56a-851c-4659-9d18-56a88d109894 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:05.748936 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f35fe56a-851c-4659-9d18-56a88d109894 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:05.749377 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f35fe56a-851c-4659-9d18-56a88d109894 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:05.911589 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-f35fe56a-851c-4659-9d18-56a88d109894 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:05.921242 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-f35fe56a-851c-4659-9d18-56a88d109894 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c" status: 200 len: 1513 microversion: 2.1 time: 0.185337 Jun 07 14:25:05.922219 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 232/440] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:05 2022] GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:05.984766 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-1b0c7e0d-eec4-4031-b351-80c3b2aa7ca2 req-f3372499-9f48-4b35-b952-847e58868b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dc684fd-368e-45b1-b487-b39a2552b70c", "name": "network-vif-deleted", "tag": "52d793d5-4bb0-44e5-9e83-b03db851e80b"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:25:05.998893 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-1b0c7e0d-eec4-4031-b351-80c3b2aa7ca2 req-f3372499-9f48-4b35-b952-847e58868b5a service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:05.999506 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-1b0c7e0d-eec4-4031-b351-80c3b2aa7ca2 req-f3372499-9f48-4b35-b952-847e58868b5a service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:06.013881 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-1b0c7e0d-eec4-4031-b351-80c3b2aa7ca2 req-f3372499-9f48-4b35-b952-847e58868b5a service nova] Creating event network-vif-deleted:52d793d5-4bb0-44e5-9e83-b03db851e80b for instance 2dc684fd-368e-45b1-b487-b39a2552b70c on hv-cinder-83608 Jun 07 14:25:06.019524 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-1b0c7e0d-eec4-4031-b351-80c3b2aa7ca2 req-f3372499-9f48-4b35-b952-847e58868b5a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038608 Jun 07 14:25:06.020127 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 209/441] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:25:06.937804 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-4178532f-5ce4-47dd-9bd6-0d36ad1419a5 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:06.938574 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-4178532f-5ce4-47dd-9bd6-0d36ad1419a5 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 2dc684fd-368e-45b1-b487-b39a2552b70c] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:06.944953 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4178532f-5ce4-47dd-9bd6-0d36ad1419a5 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:06.945407 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4178532f-5ce4-47dd-9bd6-0d36ad1419a5 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:06.946943 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4178532f-5ce4-47dd-9bd6-0d36ad1419a5 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:06.947414 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4178532f-5ce4-47dd-9bd6-0d36ad1419a5 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:06.960600 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-4178532f-5ce4-47dd-9bd6-0d36ad1419a5 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] HTTP exception thrown: Instance 2dc684fd-368e-45b1-b487-b39a2552b70c could not be found. Jun 07 14:25:06.962635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-4178532f-5ce4-47dd-9bd6-0d36ad1419a5 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Request method failure captured: Jun 07 14:25:06.962635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c HTTP/1.1 Jun 07 14:25:06.962635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:25:06.962635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:25:06.962635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:25:06.962635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:25:06.962635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:25:06.962635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:25:06.962635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:25:06.962635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:25:06.962635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin19fOKd9l_9NNrH1DlyI4QUYgRzH-q45i7OJj8OIyxCuZ3PxdCt5SsD5yD4HlGbS9hu2WDNZ3EWXOM1yOOZoWOEINF99HjhMw0NaKwnNqxGg1Q-g8XradEz73bH6D2OBoj-u5KshuVcf-pFAGUbSOs4ywpzgOJWiXP1TgT89D7V8tv4 Jun 07 14:25:06.962635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:25:06.962635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:25:06.962635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:25:06.962635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:25:06.962635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:25:06.962635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:25:06.962635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: 59f9adafa99949b3b5f624c6ae7be57e Jun 07 14:25:06.962635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-VolumesSnapshotTestJSON-506481533 Jun 07 14:25:06.962635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:25:06.962635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:25:06.964245 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/59f9adafa99949b3b5f624c6ae7be57e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_59f9adafa99949b3b5f624c6ae7be57e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/59f9adafa99949b3b5f624c6ae7be57e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/59f9adafa99949b3b5f624c6ae7be57e"}]}] Jun 07 14:25:06.964245 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-VolumesSnapshotTestJSON-506481533 Jun 07 14:25:06.964245 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: 59f9adafa99949b3b5f624c6ae7be57e Jun 07 14:25:06.964245 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-506481533 Jun 07 14:25:06.964245 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-VolumesSnapshotTestJSON-506481533-project Jun 07 14:25:06.964245 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:25:06.964245 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:25:06.964245 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: 79357bc4bc0d4b8d9dd5b07a25510f3a Jun 07 14:25:06.964245 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-VolumesSnapshotTestJSON-506481533-project Jun 07 14:25:06.964245 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:25:06.964245 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance 2dc684fd-368e-45b1-b487-b39a2552b70c could not be found. Jun 07 14:25:06.964245 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': '2dc684fd-368e-45b1-b487-b39a2552b70c'} Jun 07 14:25:06.965064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:25:06.965064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:25:06.965064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:25:06.965064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:25:06.965064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:25:06.965064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:25:06.965064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:25:06.965064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:25:06.965064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:25:06.965064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:25:06.965064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dc684fd-368e-45b1-b487-b39a2552b70c could not be found. Jun 07 14:25:06.965064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:25:06.965064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:25:06.965064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:25:06.965064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:25:06.965064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:25:06.965064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:25:06.965064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:25:06.965064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:25:06.965064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:25:06.966548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:25:06.966548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:25:06.966548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:25:06.966548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:25:06.966548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:25:06.966548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:25:06.966548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:25:06.966548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dc684fd-368e-45b1-b487-b39a2552b70c could not be found. Jun 07 14:25:06.966548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:25:06.966548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:25:06.966548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:25:06.966548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:25:06.966548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:25:06.966548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:25:06.966548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:25:06.966548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:25:06.966548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dc684fd-368e-45b1-b487-b39a2552b70c could not be found. Jun 07 14:25:06.966548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:25:06.967867 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-4178532f-5ce4-47dd-9bd6-0d36ad1419a5 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Returning 404 to user: Instance 2dc684fd-368e-45b1-b487-b39a2552b70c could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:25:06.967867 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-4178532f-5ce4-47dd-9bd6-0d36ad1419a5 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c" status: 404 len: 111 microversion: 2.1 time: 0.030165 Jun 07 14:25:06.967867 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 233/442] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:06 2022] GET /compute/v2.1/servers/2dc684fd-368e-45b1-b487-b39a2552b70c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:25:15.833746 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3284cd2a-8d9f-4b1b-9ee1-aaeb9d5fafd8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-853023463", "imageRef": "2864004b-970a-480b-8453-14794f9ccca2", "flavorRef": "452", "networks": [{"uuid": "74e54650-a65d-4ca7-9de2-261f4002b6e6"}]}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:25:15.892210 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.network.neutron [None req-3284cd2a-8d9f-4b1b-9ee1-aaeb9d5fafd8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] validate_networks() for [('74e54650-a65d-4ca7-9de2-261f4002b6e6', None, None, None, None, None)] {{(pid=117564) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:25:16.013279 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:16.287501 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-3284cd2a-8d9f-4b1b-9ee1-aaeb9d5fafd8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Flavor limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:25:16.288085 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-3284cd2a-8d9f-4b1b-9ee1-aaeb9d5fafd8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Image limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:25:16.288835 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-3284cd2a-8d9f-4b1b-9ee1-aaeb9d5fafd8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Flavor pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:25:16.290133 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-3284cd2a-8d9f-4b1b-9ee1-aaeb9d5fafd8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Image pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:25:16.290860 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-3284cd2a-8d9f-4b1b-9ee1-aaeb9d5fafd8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:25:16.304003 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3284cd2a-8d9f-4b1b-9ee1-aaeb9d5fafd8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:16.304622 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3284cd2a-8d9f-4b1b-9ee1-aaeb9d5fafd8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:16.305743 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3284cd2a-8d9f-4b1b-9ee1-aaeb9d5fafd8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:16.306246 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3284cd2a-8d9f-4b1b-9ee1-aaeb9d5fafd8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:16.328185 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-3284cd2a-8d9f-4b1b-9ee1-aaeb9d5fafd8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Getting quotas for project 59f9adafa99949b3b5f624c6ae7be57e. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:25:16.332548 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-3284cd2a-8d9f-4b1b-9ee1-aaeb9d5fafd8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Getting quotas for user 79357bc4bc0d4b8d9dd5b07a25510f3a and project 59f9adafa99949b3b5f624c6ae7be57e. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:25:16.347972 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3284cd2a-8d9f-4b1b-9ee1-aaeb9d5fafd8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Going to run 1 instances... {{(pid=117564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:25:16.350985 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3284cd2a-8d9f-4b1b-9ee1-aaeb9d5fafd8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 57975a90-732f-4014-b0eb-076c7acca1c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2864004b-970a-480b-8453-14794f9ccca2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:25:16.412902 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3284cd2a-8d9f-4b1b-9ee1-aaeb9d5fafd8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581647 Jun 07 14:25:16.413768 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 210/443] 10.222.0.81 () {60 vars in 1146 bytes} [Tue Jun 7 14:25:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:25:16.428799 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-6b189dd8-95ff-4ad7-8ae7-66d4791e6e74 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:16.430679 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-6b189dd8-95ff-4ad7-8ae7-66d4791e6e74 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 57975a90-732f-4014-b0eb-076c7acca1c9] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:16.597308 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-6b189dd8-95ff-4ad7-8ae7-66d4791e6e74 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:16.608342 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-6b189dd8-95ff-4ad7-8ae7-66d4791e6e74 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9" status: 200 len: 1218 microversion: 2.1 time: 0.183766 Jun 07 14:25:16.609782 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 234/444] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:16 2022] GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9 => generated 1218 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:17.626397 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1f8f5836-34ca-4b8b-98a7-c51b6d56d7e2 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:17.627021 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1f8f5836-34ca-4b8b-98a7-c51b6d56d7e2 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 57975a90-732f-4014-b0eb-076c7acca1c9] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:17.639181 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1f8f5836-34ca-4b8b-98a7-c51b6d56d7e2 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:17.639946 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1f8f5836-34ca-4b8b-98a7-c51b6d56d7e2 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:17.640719 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1f8f5836-34ca-4b8b-98a7-c51b6d56d7e2 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:17.641314 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1f8f5836-34ca-4b8b-98a7-c51b6d56d7e2 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:17.724732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1f8f5836-34ca-4b8b-98a7-c51b6d56d7e2 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:17.738689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1f8f5836-34ca-4b8b-98a7-c51b6d56d7e2 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9" status: 200 len: 1278 microversion: 2.1 time: 0.116018 Jun 07 14:25:17.740320 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 211/445] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:17 2022] GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9 => generated 1278 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:18.756490 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d02a8351-d9f5-4a8e-ab42-5feaeaba380e tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:18.757259 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-d02a8351-d9f5-4a8e-ab42-5feaeaba380e tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 57975a90-732f-4014-b0eb-076c7acca1c9] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:18.761309 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=24,nova_cell1:INSERT=1 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:18.766821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d02a8351-d9f5-4a8e-ab42-5feaeaba380e tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:18.767693 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d02a8351-d9f5-4a8e-ab42-5feaeaba380e tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:18.768594 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d02a8351-d9f5-4a8e-ab42-5feaeaba380e tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:18.769241 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d02a8351-d9f5-4a8e-ab42-5feaeaba380e tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:18.851476 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-d02a8351-d9f5-4a8e-ab42-5feaeaba380e tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:18.860561 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-d02a8351-d9f5-4a8e-ab42-5feaeaba380e tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9" status: 200 len: 1276 microversion: 2.1 time: 0.108064 Jun 07 14:25:18.862631 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 235/446] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:18 2022] GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9 => generated 1276 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:19.716240 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-357cf994-2317-4391-bcc9-e8a8740e09e9 req-51525b81-5e97-48e3-a160-65927603e565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57975a90-732f-4014-b0eb-076c7acca1c9", "tag": "ab8e8c1b-0b00-47d6-92e7-e25f91d3426f"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:25:19.743915 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-357cf994-2317-4391-bcc9-e8a8740e09e9 req-51525b81-5e97-48e3-a160-65927603e565 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:19.744310 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-357cf994-2317-4391-bcc9-e8a8740e09e9 req-51525b81-5e97-48e3-a160-65927603e565 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:19.759564 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-357cf994-2317-4391-bcc9-e8a8740e09e9 req-51525b81-5e97-48e3-a160-65927603e565 service nova] Creating event network-changed:ab8e8c1b-0b00-47d6-92e7-e25f91d3426f for instance 57975a90-732f-4014-b0eb-076c7acca1c9 on hv-cinder-83608 Jun 07 14:25:19.764747 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-357cf994-2317-4391-bcc9-e8a8740e09e9 req-51525b81-5e97-48e3-a160-65927603e565 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053663 Jun 07 14:25:19.766537 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 212/447] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:25:19.880921 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d4297c40-a266-4152-8da3-c33e84407b19 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:19.882174 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-d4297c40-a266-4152-8da3-c33e84407b19 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 57975a90-732f-4014-b0eb-076c7acca1c9] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:19.890013 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d4297c40-a266-4152-8da3-c33e84407b19 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:19.890909 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d4297c40-a266-4152-8da3-c33e84407b19 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:19.891925 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d4297c40-a266-4152-8da3-c33e84407b19 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:19.892519 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d4297c40-a266-4152-8da3-c33e84407b19 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:20.131927 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-d4297c40-a266-4152-8da3-c33e84407b19 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:20.141300 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-d4297c40-a266-4152-8da3-c33e84407b19 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9" status: 200 len: 1318 microversion: 2.1 time: 0.265333 Jun 07 14:25:20.142801 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 236/448] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:19 2022] GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:21.170353 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-41fe67ed-010f-4b33-9d2c-1ea0a3c4e279 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:21.171073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-41fe67ed-010f-4b33-9d2c-1ea0a3c4e279 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 57975a90-732f-4014-b0eb-076c7acca1c9] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:21.177842 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-41fe67ed-010f-4b33-9d2c-1ea0a3c4e279 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:21.178292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-41fe67ed-010f-4b33-9d2c-1ea0a3c4e279 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:21.179071 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-41fe67ed-010f-4b33-9d2c-1ea0a3c4e279 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:21.179535 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-41fe67ed-010f-4b33-9d2c-1ea0a3c4e279 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:21.677620 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-41fe67ed-010f-4b33-9d2c-1ea0a3c4e279 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:21.690114 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-41fe67ed-010f-4b33-9d2c-1ea0a3c4e279 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9" status: 200 len: 1318 microversion: 2.1 time: 0.532055 Jun 07 14:25:21.694208 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 213/449] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:21 2022] GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9 => generated 1318 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:21.701234 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-15a12ba5-faea-4059-8693-b6ab5edeb295 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:21.702296 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-15a12ba5-faea-4059-8693-b6ab5edeb295 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:21.709115 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-15a12ba5-faea-4059-8693-b6ab5edeb295 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:21.709840 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-15a12ba5-faea-4059-8693-b6ab5edeb295 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:21.710860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-15a12ba5-faea-4059-8693-b6ab5edeb295 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:21.711525 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-15a12ba5-faea-4059-8693-b6ab5edeb295 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:21.845295 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.objects.instance [None req-15a12ba5-faea-4059-8693-b6ab5edeb295 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lazy-loading 'services' on Instance uuid ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b {{(pid=117565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:25:21.955142 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-15a12ba5-faea-4059-8693-b6ab5edeb295 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b/os-volume_attachments/d20e704a-3621-4d68-a585-2f24a3ae9588" status: 202 len: 0 microversion: 2.1 time: 0.257522 Jun 07 14:25:21.959304 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 237/450] 10.222.0.81 () {58 vars in 1415 bytes} [Tue Jun 7 14:25:21 2022] DELETE /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b/os-volume_attachments/d20e704a-3621-4d68-a585-2f24a3ae9588 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:25:22.710469 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-84988d8a-626f-4a56-a859-00771e7416b5 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:22.711138 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-84988d8a-626f-4a56-a859-00771e7416b5 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 57975a90-732f-4014-b0eb-076c7acca1c9] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:22.727715 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-84988d8a-626f-4a56-a859-00771e7416b5 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:22.731530 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-84988d8a-626f-4a56-a859-00771e7416b5 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:22.732792 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-84988d8a-626f-4a56-a859-00771e7416b5 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:22.733809 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-84988d8a-626f-4a56-a859-00771e7416b5 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:23.067170 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-84988d8a-626f-4a56-a859-00771e7416b5 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:23.086050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-84988d8a-626f-4a56-a859-00771e7416b5 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9" status: 200 len: 1318 microversion: 2.1 time: 0.379539 Jun 07 14:25:23.096802 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 214/451] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:22 2022] GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9 => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:23.165817 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-f7882ff0-633a-4fb5-8763-66f0fb04ca7e tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:25:23.184114 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f7882ff0-633a-4fb5-8763-66f0fb04ca7e tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:23.187948 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f7882ff0-633a-4fb5-8763-66f0fb04ca7e tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:23.239609 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-f7882ff0-633a-4fb5-8763-66f0fb04ca7e tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Going to try to stop instance {{(pid=117565) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 07 14:25:23.331197 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-f7882ff0-633a-4fb5-8763-66f0fb04ca7e tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "POST /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b/action" status: 202 len: 0 microversion: 2.1 time: 0.171267 Jun 07 14:25:23.332613 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 238/452] 10.222.0.81 () {60 vars in 1277 bytes} [Tue Jun 7 14:25:23 2022] POST /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:25:23.342694 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8a09045c-2bec-4fdb-8a76-390b20864ead tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:23.343639 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8a09045c-2bec-4fdb-8a76-390b20864ead tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:23.358711 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8a09045c-2bec-4fdb-8a76-390b20864ead tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:23.360043 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8a09045c-2bec-4fdb-8a76-390b20864ead tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:23.363768 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8a09045c-2bec-4fdb-8a76-390b20864ead tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:23.373282 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8a09045c-2bec-4fdb-8a76-390b20864ead tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:23.590603 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8a09045c-2bec-4fdb-8a76-390b20864ead tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:23.612207 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8a09045c-2bec-4fdb-8a76-390b20864ead tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1673 microversion: 2.1 time: 0.274501 Jun 07 14:25:23.613135 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 215/453] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:23 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1673 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:24.104960 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-1ef62d99-72d0-49b9-9b64-ceb0028dbb81 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:24.106582 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-1ef62d99-72d0-49b9-9b64-ceb0028dbb81 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 57975a90-732f-4014-b0eb-076c7acca1c9] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:24.115113 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1ef62d99-72d0-49b9-9b64-ceb0028dbb81 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:24.115824 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1ef62d99-72d0-49b9-9b64-ceb0028dbb81 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:24.116633 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1ef62d99-72d0-49b9-9b64-ceb0028dbb81 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:24.117670 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1ef62d99-72d0-49b9-9b64-ceb0028dbb81 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:24.279134 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-1ef62d99-72d0-49b9-9b64-ceb0028dbb81 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:24.293614 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-1ef62d99-72d0-49b9-9b64-ceb0028dbb81 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9" status: 200 len: 1318 microversion: 2.1 time: 0.193635 Jun 07 14:25:24.294397 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 239/454] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:24 2022] GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:24.630299 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d62fd2a1-9b90-4128-af65-8ec8fdb82181 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:24.631088 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d62fd2a1-9b90-4128-af65-8ec8fdb82181 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:24.643451 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d62fd2a1-9b90-4128-af65-8ec8fdb82181 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:24.644188 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d62fd2a1-9b90-4128-af65-8ec8fdb82181 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:24.645270 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d62fd2a1-9b90-4128-af65-8ec8fdb82181 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:24.645809 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d62fd2a1-9b90-4128-af65-8ec8fdb82181 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:24.827087 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-d62fd2a1-9b90-4128-af65-8ec8fdb82181 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:24.835385 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d62fd2a1-9b90-4128-af65-8ec8fdb82181 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1673 microversion: 2.1 time: 0.209128 Jun 07 14:25:24.847366 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 216/455] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:24 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1673 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:25.310058 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7d5f81e3-15fc-4cf7-86d0-a0cc778f3ac7 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:25.310676 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-7d5f81e3-15fc-4cf7-86d0-a0cc778f3ac7 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 57975a90-732f-4014-b0eb-076c7acca1c9] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:25.317076 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7d5f81e3-15fc-4cf7-86d0-a0cc778f3ac7 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:25.317529 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7d5f81e3-15fc-4cf7-86d0-a0cc778f3ac7 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:25.318302 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7d5f81e3-15fc-4cf7-86d0-a0cc778f3ac7 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:25.318741 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7d5f81e3-15fc-4cf7-86d0-a0cc778f3ac7 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:25.469685 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-7d5f81e3-15fc-4cf7-86d0-a0cc778f3ac7 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:25.484655 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-7d5f81e3-15fc-4cf7-86d0-a0cc778f3ac7 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9" status: 200 len: 1318 microversion: 2.1 time: 0.178478 Jun 07 14:25:25.485559 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 240/456] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:25 2022] GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:25.854534 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0a2fdc93-6993-4184-8385-386d719bd122 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:25.855311 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0a2fdc93-6993-4184-8385-386d719bd122 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:25.861997 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0a2fdc93-6993-4184-8385-386d719bd122 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:25.862818 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0a2fdc93-6993-4184-8385-386d719bd122 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:25.865963 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0a2fdc93-6993-4184-8385-386d719bd122 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:25.866592 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0a2fdc93-6993-4184-8385-386d719bd122 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:26.026234 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0a2fdc93-6993-4184-8385-386d719bd122 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:26.034289 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0a2fdc93-6993-4184-8385-386d719bd122 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1673 microversion: 2.1 time: 0.184263 Jun 07 14:25:26.048732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 217/457] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:25 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1673 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:26.505167 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-a9c15f62-74a9-40ba-b785-33c37fdd1aa7 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:26.506507 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-a9c15f62-74a9-40ba-b785-33c37fdd1aa7 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 57975a90-732f-4014-b0eb-076c7acca1c9] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:26.513995 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a9c15f62-74a9-40ba-b785-33c37fdd1aa7 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:26.514811 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a9c15f62-74a9-40ba-b785-33c37fdd1aa7 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:26.515865 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a9c15f62-74a9-40ba-b785-33c37fdd1aa7 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:26.516590 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a9c15f62-74a9-40ba-b785-33c37fdd1aa7 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:26.608156 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=2 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:26.717378 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-a9c15f62-74a9-40ba-b785-33c37fdd1aa7 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:26.777273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-a9c15f62-74a9-40ba-b785-33c37fdd1aa7 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9" status: 200 len: 1318 microversion: 2.1 time: 0.279168 Jun 07 14:25:26.778194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 241/458] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:26 2022] GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:27.053942 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-16f731be-8fc9-4e16-9cc7-549a77d7f062 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:27.056235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-16f731be-8fc9-4e16-9cc7-549a77d7f062 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:27.058405 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:27.059421 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=6 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:27.072584 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-16f731be-8fc9-4e16-9cc7-549a77d7f062 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:27.073597 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-16f731be-8fc9-4e16-9cc7-549a77d7f062 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:27.075184 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-16f731be-8fc9-4e16-9cc7-549a77d7f062 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:27.076717 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-16f731be-8fc9-4e16-9cc7-549a77d7f062 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:27.089574 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-5f81f57c-fffd-430f-9e08-0a3e05b9e097 req-0ece3418-590b-40b3-b0f9-f90e3112d7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57975a90-732f-4014-b0eb-076c7acca1c9", "name": "network-vif-plugged", "status": "completed", "tag": "ab8e8c1b-0b00-47d6-92e7-e25f91d3426f"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:25:27.104858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-5f81f57c-fffd-430f-9e08-0a3e05b9e097 req-0ece3418-590b-40b3-b0f9-f90e3112d7e7 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:27.105300 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-5f81f57c-fffd-430f-9e08-0a3e05b9e097 req-0ece3418-590b-40b3-b0f9-f90e3112d7e7 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:27.126264 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-5f81f57c-fffd-430f-9e08-0a3e05b9e097 req-0ece3418-590b-40b3-b0f9-f90e3112d7e7 service nova] Creating event network-vif-plugged:ab8e8c1b-0b00-47d6-92e7-e25f91d3426f for instance 57975a90-732f-4014-b0eb-076c7acca1c9 on hv-cinder-83608 Jun 07 14:25:27.131260 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-5f81f57c-fffd-430f-9e08-0a3e05b9e097 req-0ece3418-590b-40b3-b0f9-f90e3112d7e7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045593 Jun 07 14:25:27.132698 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 242/459] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:25:27.287558 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-16f731be-8fc9-4e16-9cc7-549a77d7f062 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:27.297555 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-16f731be-8fc9-4e16-9cc7-549a77d7f062 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1673 microversion: 2.1 time: 0.247462 Jun 07 14:25:27.311680 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 218/460] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:27 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1673 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:27.797573 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-25cda4be-e4e9-4d30-b8d9-b9bd279bc4d3 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:27.799130 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-25cda4be-e4e9-4d30-b8d9-b9bd279bc4d3 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 57975a90-732f-4014-b0eb-076c7acca1c9] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:27.806479 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-25cda4be-e4e9-4d30-b8d9-b9bd279bc4d3 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:27.807186 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-25cda4be-e4e9-4d30-b8d9-b9bd279bc4d3 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:27.808268 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-25cda4be-e4e9-4d30-b8d9-b9bd279bc4d3 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:27.808708 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-25cda4be-e4e9-4d30-b8d9-b9bd279bc4d3 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:28.013095 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-25cda4be-e4e9-4d30-b8d9-b9bd279bc4d3 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:28.022189 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-25cda4be-e4e9-4d30-b8d9-b9bd279bc4d3 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9" status: 200 len: 1318 microversion: 2.1 time: 0.231668 Jun 07 14:25:28.023481 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 243/461] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:27 2022] GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:28.316993 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c8e9a128-1a2a-4cd7-890f-3993693bc4e8 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:28.318343 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c8e9a128-1a2a-4cd7-890f-3993693bc4e8 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:28.330292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c8e9a128-1a2a-4cd7-890f-3993693bc4e8 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:28.330748 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c8e9a128-1a2a-4cd7-890f-3993693bc4e8 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:28.331560 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c8e9a128-1a2a-4cd7-890f-3993693bc4e8 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:28.332004 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c8e9a128-1a2a-4cd7-890f-3993693bc4e8 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:28.537783 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c8e9a128-1a2a-4cd7-890f-3993693bc4e8 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:28.546006 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c8e9a128-1a2a-4cd7-890f-3993693bc4e8 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1673 microversion: 2.1 time: 0.233665 Jun 07 14:25:28.546899 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 219/462] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:28 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1673 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:29.040408 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-fd20fa5f-c259-499b-b8c1-d3d73dcce332 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:29.041028 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-fd20fa5f-c259-499b-b8c1-d3d73dcce332 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 57975a90-732f-4014-b0eb-076c7acca1c9] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:29.050096 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fd20fa5f-c259-499b-b8c1-d3d73dcce332 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:29.050864 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fd20fa5f-c259-499b-b8c1-d3d73dcce332 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:29.051915 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fd20fa5f-c259-499b-b8c1-d3d73dcce332 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:29.052571 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fd20fa5f-c259-499b-b8c1-d3d73dcce332 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:29.243925 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-fd20fa5f-c259-499b-b8c1-d3d73dcce332 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:29.259525 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-fd20fa5f-c259-499b-b8c1-d3d73dcce332 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9" status: 200 len: 1318 microversion: 2.1 time: 0.220887 Jun 07 14:25:29.260143 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 244/463] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:29 2022] GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:29.563713 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5e43c80b-eb46-4574-894d-ae0eec36d4be tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:29.564919 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-5e43c80b-eb46-4574-894d-ae0eec36d4be tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:29.572992 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5e43c80b-eb46-4574-894d-ae0eec36d4be tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:29.573698 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5e43c80b-eb46-4574-894d-ae0eec36d4be tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:29.574636 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5e43c80b-eb46-4574-894d-ae0eec36d4be tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:29.575246 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5e43c80b-eb46-4574-894d-ae0eec36d4be tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:29.735987 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5e43c80b-eb46-4574-894d-ae0eec36d4be tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:29.746681 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-5e43c80b-eb46-4574-894d-ae0eec36d4be tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1673 microversion: 2.1 time: 0.186701 Jun 07 14:25:29.752695 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 220/464] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:29 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1673 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:30.277392 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-af79c3fb-5f77-4d13-88aa-a91bde542221 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:30.278652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-af79c3fb-5f77-4d13-88aa-a91bde542221 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 57975a90-732f-4014-b0eb-076c7acca1c9] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:30.287598 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-af79c3fb-5f77-4d13-88aa-a91bde542221 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:30.288281 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-af79c3fb-5f77-4d13-88aa-a91bde542221 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:30.289771 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-af79c3fb-5f77-4d13-88aa-a91bde542221 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:30.290466 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-af79c3fb-5f77-4d13-88aa-a91bde542221 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:30.463283 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-af79c3fb-5f77-4d13-88aa-a91bde542221 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:30.473697 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-af79c3fb-5f77-4d13-88aa-a91bde542221 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9" status: 200 len: 1506 microversion: 2.1 time: 0.200526 Jun 07 14:25:30.474284 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 245/465] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:30 2022] GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9 => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:30.494010 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-dfe8472e-cf91-435c-9b3d-9ae5ce954d78 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a74f5b6-fe51-4229-a2c5-e8ebeef325b6", "device": "/dev/sdb"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:25:30.495208 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-dfe8472e-cf91-435c-9b3d-9ae5ce954d78 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 57975a90-732f-4014-b0eb-076c7acca1c9] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:30.501666 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dfe8472e-cf91-435c-9b3d-9ae5ce954d78 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:30.502439 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dfe8472e-cf91-435c-9b3d-9ae5ce954d78 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:30.503655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dfe8472e-cf91-435c-9b3d-9ae5ce954d78 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:30.504279 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dfe8472e-cf91-435c-9b3d-9ae5ce954d78 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:30.765065 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-53c2d41c-7bcb-469b-b945-36f280a0e457 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:30.766351 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-53c2d41c-7bcb-469b-b945-36f280a0e457 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:30.784159 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-53c2d41c-7bcb-469b-b945-36f280a0e457 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:30.784650 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-53c2d41c-7bcb-469b-b945-36f280a0e457 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:30.785545 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-53c2d41c-7bcb-469b-b945-36f280a0e457 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:30.786009 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-53c2d41c-7bcb-469b-b945-36f280a0e457 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:30.809683 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-dfe8472e-cf91-435c-9b3d-9ae5ce954d78 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "POST /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322635 Jun 07 14:25:30.813039 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 221/466] 10.222.0.81 () {60 vars in 1322 bytes} [Tue Jun 7 14:25:30 2022] POST /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:25:31.020973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-53c2d41c-7bcb-469b-b945-36f280a0e457 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:31.030088 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-53c2d41c-7bcb-469b-b945-36f280a0e457 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1673 microversion: 2.1 time: 0.269002 Jun 07 14:25:31.031077 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 246/467] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:30 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1673 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:25:32.049653 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-fe7360c0-a0b5-4952-a513-5366fd1ca484 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:32.050349 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-fe7360c0-a0b5-4952-a513-5366fd1ca484 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:32.057940 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fe7360c0-a0b5-4952-a513-5366fd1ca484 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:32.058394 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fe7360c0-a0b5-4952-a513-5366fd1ca484 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:32.059176 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fe7360c0-a0b5-4952-a513-5366fd1ca484 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:32.059639 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fe7360c0-a0b5-4952-a513-5366fd1ca484 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:32.216143 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-fe7360c0-a0b5-4952-a513-5366fd1ca484 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:32.224736 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-fe7360c0-a0b5-4952-a513-5366fd1ca484 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1673 microversion: 2.1 time: 0.180207 Jun 07 14:25:32.227688 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 222/468] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:32 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1673 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:33.242039 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-cd5e8ee1-c737-4172-b129-3c334b61c7ff tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:33.242809 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-cd5e8ee1-c737-4172-b129-3c334b61c7ff tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:33.245911 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=37 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:33.249696 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cd5e8ee1-c737-4172-b129-3c334b61c7ff tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:33.250154 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cd5e8ee1-c737-4172-b129-3c334b61c7ff tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:33.250926 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cd5e8ee1-c737-4172-b129-3c334b61c7ff tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:33.251607 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cd5e8ee1-c737-4172-b129-3c334b61c7ff tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:33.394417 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-cd5e8ee1-c737-4172-b129-3c334b61c7ff tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:33.403354 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-cd5e8ee1-c737-4172-b129-3c334b61c7ff tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1673 microversion: 2.1 time: 0.165281 Jun 07 14:25:33.407251 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 247/469] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:33 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:34.377247 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f31b16cd-3ea5-4e04-a74d-5418b74806e3 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Action: 'create', calling method: .version_select at 0x7ff37f525670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-20677943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+0Jtk8R5lyP8juwwjqU3ZJeIOfg0mOhv7B1bB21ABVPMV7AzX/C2pw8gAO8FjUwJTsfmwXDFQXlgyCpOHIPSBx7sYlE1ubM0XLl+ynPooMFrDgJL8oLmLCOueC04w0ow=="}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:25:34.381785 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:34.394983 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-f31b16cd-3ea5-4e04-a74d-5418b74806e3 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Getting quotas for project 1c7b98807cae4a75968ed946de9c92bb. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:25:34.399668 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-f31b16cd-3ea5-4e04-a74d-5418b74806e3 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Getting quotas for user 9bb946aacaf145d5b718f82e28c999d9 and project 1c7b98807cae4a75968ed946de9c92bb. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:25:34.420742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-217b82a1-0afc-438b-b047-dc2d0ab6e511 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:34.421364 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-217b82a1-0afc-438b-b047-dc2d0ab6e511 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:34.421464 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f31b16cd-3ea5-4e04-a74d-5418b74806e3 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.048248 Jun 07 14:25:34.422069 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 223/470] 10.222.0.81 () {60 vars in 1158 bytes} [Tue Jun 7 14:25:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:25:34.433606 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-217b82a1-0afc-438b-b047-dc2d0ab6e511 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:34.433606 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-217b82a1-0afc-438b-b047-dc2d0ab6e511 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:34.433606 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-217b82a1-0afc-438b-b047-dc2d0ab6e511 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:34.433606 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-217b82a1-0afc-438b-b047-dc2d0ab6e511 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:34.470969 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-693c199e-322f-4d16-b62b-e26ca04bc887 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-123905279", "imageRef": "6f419309-68e8-4f50-8dcf-f44b4e307c24", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-20677943", "networks": [{"uuid": "d4d298de-4ac9-4be1-9225-de274b18204d"}]}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:25:34.521109 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.network.neutron [None req-693c199e-322f-4d16-b62b-e26ca04bc887 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] validate_networks() for [('d4d298de-4ac9-4be1-9225-de274b18204d', None, None, None, None, None)] {{(pid=117564) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:25:34.621449 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-217b82a1-0afc-438b-b047-dc2d0ab6e511 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:34.629016 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-217b82a1-0afc-438b-b047-dc2d0ab6e511 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1650 microversion: 2.1 time: 0.212184 Jun 07 14:25:34.629671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 248/471] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:34 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1650 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:25:34.645383 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3cd42880-8e1f-4f19-ae46-b1a661a322f8 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:25:34.652160 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3cd42880-8e1f-4f19-ae46-b1a661a322f8 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:34.652602 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3cd42880-8e1f-4f19-ae46-b1a661a322f8 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:34.675351 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-3cd42880-8e1f-4f19-ae46-b1a661a322f8 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Going to try to start instance {{(pid=117565) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 07 14:25:34.700673 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:34.723411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-3cd42880-8e1f-4f19-ae46-b1a661a322f8 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "POST /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b/action" status: 202 len: 0 microversion: 2.1 time: 0.081661 Jun 07 14:25:34.724336 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 249/472] 10.222.0.81 () {60 vars in 1277 bytes} [Tue Jun 7 14:25:34 2022] POST /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 14:25:34.732523 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-b1c53410-a340-4065-9db3-730334f5e9b5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:34.733221 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-b1c53410-a340-4065-9db3-730334f5e9b5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:34.740177 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b1c53410-a340-4065-9db3-730334f5e9b5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:34.740626 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b1c53410-a340-4065-9db3-730334f5e9b5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:34.741400 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b1c53410-a340-4065-9db3-730334f5e9b5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:34.742067 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b1c53410-a340-4065-9db3-730334f5e9b5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:34.986203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-b1c53410-a340-4065-9db3-730334f5e9b5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:34.995161 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-b1c53410-a340-4065-9db3-730334f5e9b5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1659 microversion: 2.1 time: 0.266642 Jun 07 14:25:34.995766 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 250/473] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:34 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1659 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:25:35.019247 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-693c199e-322f-4d16-b62b-e26ca04bc887 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Flavor limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:25:35.019689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-693c199e-322f-4d16-b62b-e26ca04bc887 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Image limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:25:35.020171 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-693c199e-322f-4d16-b62b-e26ca04bc887 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Flavor pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:25:35.020591 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-693c199e-322f-4d16-b62b-e26ca04bc887 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Image pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:25:35.021010 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-693c199e-322f-4d16-b62b-e26ca04bc887 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:25:35.030371 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-693c199e-322f-4d16-b62b-e26ca04bc887 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:35.030819 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-693c199e-322f-4d16-b62b-e26ca04bc887 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:35.031655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-693c199e-322f-4d16-b62b-e26ca04bc887 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:35.032084 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-693c199e-322f-4d16-b62b-e26ca04bc887 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:35.049309 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-693c199e-322f-4d16-b62b-e26ca04bc887 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Getting quotas for project 1c7b98807cae4a75968ed946de9c92bb. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:25:35.053187 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-693c199e-322f-4d16-b62b-e26ca04bc887 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Getting quotas for user 9bb946aacaf145d5b718f82e28c999d9 and project 1c7b98807cae4a75968ed946de9c92bb. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:25:35.065191 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-693c199e-322f-4d16-b62b-e26ca04bc887 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Going to run 1 instances... {{(pid=117564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:25:35.067406 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-693c199e-322f-4d16-b62b-e26ca04bc887 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f419309-68e8-4f50-8dcf-f44b4e307c24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:25:35.115869 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-693c199e-322f-4d16-b62b-e26ca04bc887 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.648880 Jun 07 14:25:35.121594 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 224/474] 10.222.0.81 () {60 vars in 1146 bytes} [Tue Jun 7 14:25:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 14:25:35.132479 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-95ab833a-43c6-43a1-86d6-77cf7859ba66 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:35.136264 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-95ab833a-43c6-43a1-86d6-77cf7859ba66 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:35.204417 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-95ab833a-43c6-43a1-86d6-77cf7859ba66 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:35.213161 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-95ab833a-43c6-43a1-86d6-77cf7859ba66 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1256 microversion: 2.1 time: 0.086533 Jun 07 14:25:35.213709 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 251/475] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:35 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1256 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:36.013642 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1df7bf17-478b-40ad-9f2d-cff55662bca1 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:36.014263 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1df7bf17-478b-40ad-9f2d-cff55662bca1 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:36.020607 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1df7bf17-478b-40ad-9f2d-cff55662bca1 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:36.021009 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1df7bf17-478b-40ad-9f2d-cff55662bca1 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:36.021780 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1df7bf17-478b-40ad-9f2d-cff55662bca1 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:36.022230 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1df7bf17-478b-40ad-9f2d-cff55662bca1 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:36.155543 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1df7bf17-478b-40ad-9f2d-cff55662bca1 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:36.163265 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1df7bf17-478b-40ad-9f2d-cff55662bca1 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1659 microversion: 2.1 time: 0.153960 Jun 07 14:25:36.164918 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 225/476] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:36 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1659 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:36.230434 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-917e040b-09ff-47d1-88ad-3276e3d32e1a tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:36.231076 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-917e040b-09ff-47d1-88ad-3276e3d32e1a tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:36.236865 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-917e040b-09ff-47d1-88ad-3276e3d32e1a tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:36.237308 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-917e040b-09ff-47d1-88ad-3276e3d32e1a tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:36.238061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-917e040b-09ff-47d1-88ad-3276e3d32e1a tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:36.238489 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-917e040b-09ff-47d1-88ad-3276e3d32e1a tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:36.299603 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-917e040b-09ff-47d1-88ad-3276e3d32e1a tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:36.308761 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-917e040b-09ff-47d1-88ad-3276e3d32e1a tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1308 microversion: 2.1 time: 0.082722 Jun 07 14:25:36.314592 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 252/477] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:36 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1308 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:36.957412 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-463c5bbf-0fdb-4705-8b3e-00e511678f3a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b86732f-24bd-4813-91d4-7eef0779dd78"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:25:36.958497 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-463c5bbf-0fdb-4705-8b3e-00e511678f3a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:36.964668 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-463c5bbf-0fdb-4705-8b3e-00e511678f3a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:36.965124 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-463c5bbf-0fdb-4705-8b3e-00e511678f3a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:36.965895 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-463c5bbf-0fdb-4705-8b3e-00e511678f3a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:36.966338 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-463c5bbf-0fdb-4705-8b3e-00e511678f3a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:37.181983 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-70de44c1-1460-418f-8099-cb2887d851ff tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:37.182602 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-70de44c1-1460-418f-8099-cb2887d851ff tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:37.188717 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-70de44c1-1460-418f-8099-cb2887d851ff tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:37.189164 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-70de44c1-1460-418f-8099-cb2887d851ff tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:37.189919 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-70de44c1-1460-418f-8099-cb2887d851ff tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:37.190358 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-70de44c1-1460-418f-8099-cb2887d851ff tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:37.319885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-70de44c1-1460-418f-8099-cb2887d851ff tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:37.327479 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-70de44c1-1460-418f-8099-cb2887d851ff tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1663 microversion: 2.1 time: 0.150517 Jun 07 14:25:37.328046 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 253/478] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:37 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1663 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:25:37.332514 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-effa0060-f08a-43d9-a46d-fa8f087f7836 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:37.333112 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-effa0060-f08a-43d9-a46d-fa8f087f7836 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:37.339269 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-effa0060-f08a-43d9-a46d-fa8f087f7836 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:37.339723 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-effa0060-f08a-43d9-a46d-fa8f087f7836 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:37.340480 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-effa0060-f08a-43d9-a46d-fa8f087f7836 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:37.340916 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-effa0060-f08a-43d9-a46d-fa8f087f7836 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:37.400780 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-effa0060-f08a-43d9-a46d-fa8f087f7836 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:37.408405 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-effa0060-f08a-43d9-a46d-fa8f087f7836 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1314 microversion: 2.1 time: 0.079092 Jun 07 14:25:37.408975 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 254/479] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:37 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1314 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:37.823771 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:37.834403 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-463c5bbf-0fdb-4705-8b3e-00e511678f3a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "POST /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.880963 Jun 07 14:25:37.835020 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 226/480] 10.222.0.81 () {60 vars in 1322 bytes} [Tue Jun 7 14:25:36 2022] POST /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd/os-volume_attachments => generated 194 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:25:38.426060 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-2cd36e42-a2e6-404c-8e1a-9235217495c0 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:38.426870 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-2cd36e42-a2e6-404c-8e1a-9235217495c0 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:38.438626 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2cd36e42-a2e6-404c-8e1a-9235217495c0 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:38.439381 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2cd36e42-a2e6-404c-8e1a-9235217495c0 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:38.441497 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2cd36e42-a2e6-404c-8e1a-9235217495c0 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:38.444660 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2cd36e42-a2e6-404c-8e1a-9235217495c0 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:38.603685 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-2cd36e42-a2e6-404c-8e1a-9235217495c0 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:38.621079 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-2cd36e42-a2e6-404c-8e1a-9235217495c0 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1356 microversion: 2.1 time: 0.198844 Jun 07 14:25:38.621666 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 255/481] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:38 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1356 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:39.639733 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-89d9993b-c938-48ac-9629-9b8d4d5e2d3f tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:39.640473 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-89d9993b-c938-48ac-9629-9b8d4d5e2d3f tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:39.646803 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-89d9993b-c938-48ac-9629-9b8d4d5e2d3f tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:39.647284 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-89d9993b-c938-48ac-9629-9b8d4d5e2d3f tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:39.648106 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-89d9993b-c938-48ac-9629-9b8d4d5e2d3f tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:39.648548 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-89d9993b-c938-48ac-9629-9b8d4d5e2d3f tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:39.800151 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-89d9993b-c938-48ac-9629-9b8d4d5e2d3f tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:39.807687 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-89d9993b-c938-48ac-9629-9b8d4d5e2d3f tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1356 microversion: 2.1 time: 0.173024 Jun 07 14:25:39.808252 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 227/482] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:39 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1356 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:40.825837 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-54d5d44d-b60b-4df2-9974-57248c260927 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:40.827519 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-54d5d44d-b60b-4df2-9974-57248c260927 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:40.834705 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-54d5d44d-b60b-4df2-9974-57248c260927 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:40.835702 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-54d5d44d-b60b-4df2-9974-57248c260927 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:40.837054 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-54d5d44d-b60b-4df2-9974-57248c260927 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:40.837738 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-54d5d44d-b60b-4df2-9974-57248c260927 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:40.996047 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-54d5d44d-b60b-4df2-9974-57248c260927 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:41.004896 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-54d5d44d-b60b-4df2-9974-57248c260927 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1356 microversion: 2.1 time: 0.183833 Jun 07 14:25:41.005469 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 256/483] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:40 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1356 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:42.022278 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-01e7c56e-3e8f-41f3-b2ea-7058bb91d9a7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:42.023461 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-01e7c56e-3e8f-41f3-b2ea-7058bb91d9a7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:42.030491 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-01e7c56e-3e8f-41f3-b2ea-7058bb91d9a7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:42.030964 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-01e7c56e-3e8f-41f3-b2ea-7058bb91d9a7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:42.031858 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-01e7c56e-3e8f-41f3-b2ea-7058bb91d9a7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:42.032300 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-01e7c56e-3e8f-41f3-b2ea-7058bb91d9a7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:42.186651 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-01e7c56e-3e8f-41f3-b2ea-7058bb91d9a7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:42.194121 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-01e7c56e-3e8f-41f3-b2ea-7058bb91d9a7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1356 microversion: 2.1 time: 0.176051 Jun 07 14:25:42.195415 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 228/484] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:42 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1356 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:43.211985 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ea6eebb3-a270-4482-88eb-2e895852c255 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:43.212606 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ea6eebb3-a270-4482-88eb-2e895852c255 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:43.218631 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ea6eebb3-a270-4482-88eb-2e895852c255 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:43.219076 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ea6eebb3-a270-4482-88eb-2e895852c255 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:43.219883 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ea6eebb3-a270-4482-88eb-2e895852c255 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:43.220580 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ea6eebb3-a270-4482-88eb-2e895852c255 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:43.355489 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ea6eebb3-a270-4482-88eb-2e895852c255 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:43.362982 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ea6eebb3-a270-4482-88eb-2e895852c255 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1356 microversion: 2.1 time: 0.155357 Jun 07 14:25:43.363579 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 257/485] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:43 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1356 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:44.381246 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-4b8ce955-02ef-4624-9d41-336797346e05 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:44.384050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-4b8ce955-02ef-4624-9d41-336797346e05 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:44.390720 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4b8ce955-02ef-4624-9d41-336797346e05 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:44.391161 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4b8ce955-02ef-4624-9d41-336797346e05 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:44.392198 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4b8ce955-02ef-4624-9d41-336797346e05 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:44.392629 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4b8ce955-02ef-4624-9d41-336797346e05 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:44.533185 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-4b8ce955-02ef-4624-9d41-336797346e05 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:44.542421 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-4b8ce955-02ef-4624-9d41-336797346e05 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1356 microversion: 2.1 time: 0.165541 Jun 07 14:25:44.543538 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 229/486] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:44 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1356 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:25:45.560254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-17256332-4a9c-4dde-b847-4a3e66b9fc80 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:45.561479 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-17256332-4a9c-4dde-b847-4a3e66b9fc80 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:45.567973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=2 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:45.570610 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-17256332-4a9c-4dde-b847-4a3e66b9fc80 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:45.571063 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-17256332-4a9c-4dde-b847-4a3e66b9fc80 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:45.572012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-17256332-4a9c-4dde-b847-4a3e66b9fc80 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:45.572455 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-17256332-4a9c-4dde-b847-4a3e66b9fc80 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:45.710091 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-17256332-4a9c-4dde-b847-4a3e66b9fc80 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:45.719593 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-17256332-4a9c-4dde-b847-4a3e66b9fc80 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1356 microversion: 2.1 time: 0.162777 Jun 07 14:25:45.720895 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 258/487] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:45 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:25:46.737926 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0bf9fd0b-f3a8-4f08-b219-8b4633e9c72d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:46.738544 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0bf9fd0b-f3a8-4f08-b219-8b4633e9c72d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:46.740541 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:46.741271 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=10 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:46.748862 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0bf9fd0b-f3a8-4f08-b219-8b4633e9c72d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:46.749309 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0bf9fd0b-f3a8-4f08-b219-8b4633e9c72d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:46.750073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0bf9fd0b-f3a8-4f08-b219-8b4633e9c72d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:46.750510 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0bf9fd0b-f3a8-4f08-b219-8b4633e9c72d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:46.894267 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0bf9fd0b-f3a8-4f08-b219-8b4633e9c72d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:46.902405 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0bf9fd0b-f3a8-4f08-b219-8b4633e9c72d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1356 microversion: 2.1 time: 0.168387 Jun 07 14:25:46.902982 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 230/488] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:46 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1356 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:47.919914 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7fa0faff-8bc5-4e58-b5cc-bb76af5f0f17 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:47.920512 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-7fa0faff-8bc5-4e58-b5cc-bb76af5f0f17 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:47.926937 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7fa0faff-8bc5-4e58-b5cc-bb76af5f0f17 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:47.927567 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7fa0faff-8bc5-4e58-b5cc-bb76af5f0f17 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:47.928427 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7fa0faff-8bc5-4e58-b5cc-bb76af5f0f17 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:47.928942 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7fa0faff-8bc5-4e58-b5cc-bb76af5f0f17 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:48.079844 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-7fa0faff-8bc5-4e58-b5cc-bb76af5f0f17 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:48.088480 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-7fa0faff-8bc5-4e58-b5cc-bb76af5f0f17 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1356 microversion: 2.1 time: 0.172323 Jun 07 14:25:48.089066 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 259/489] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:47 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1356 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:49.108560 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-dd92b46b-9dba-4abb-b995-6da48747c0e1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:49.109161 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-dd92b46b-9dba-4abb-b995-6da48747c0e1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:49.115538 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dd92b46b-9dba-4abb-b995-6da48747c0e1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:49.115983 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dd92b46b-9dba-4abb-b995-6da48747c0e1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:49.116833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dd92b46b-9dba-4abb-b995-6da48747c0e1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:49.117290 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dd92b46b-9dba-4abb-b995-6da48747c0e1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:49.268983 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-dd92b46b-9dba-4abb-b995-6da48747c0e1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:49.277418 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-dd92b46b-9dba-4abb-b995-6da48747c0e1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1356 microversion: 2.1 time: 0.172814 Jun 07 14:25:49.278009 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 231/490] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:49 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1356 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:25:50.294484 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-b543926b-1d2c-4792-af5a-943047a0c7a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:50.295097 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-b543926b-1d2c-4792-af5a-943047a0c7a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:50.300939 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b543926b-1d2c-4792-af5a-943047a0c7a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:50.301381 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b543926b-1d2c-4792-af5a-943047a0c7a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:50.302132 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b543926b-1d2c-4792-af5a-943047a0c7a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:50.302562 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b543926b-1d2c-4792-af5a-943047a0c7a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:50.496419 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-b543926b-1d2c-4792-af5a-943047a0c7a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:50.504081 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-b543926b-1d2c-4792-af5a-943047a0c7a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1356 microversion: 2.1 time: 0.214041 Jun 07 14:25:50.504767 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 260/491] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:50 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1356 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:50.798927 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-e6419595-74ee-4c29-8a00-f3e519f36ca2 req-6f4ce15d-e709-4490-b5c9-49586e06d69e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad12cd77-70c4-4d1b-a6c3-66ba546ad15a", "tag": "f2581f0d-52d5-4fd2-aac8-ba96fe0f65ed"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:25:50.813338 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-e6419595-74ee-4c29-8a00-f3e519f36ca2 req-6f4ce15d-e709-4490-b5c9-49586e06d69e service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:50.813995 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-e6419595-74ee-4c29-8a00-f3e519f36ca2 req-6f4ce15d-e709-4490-b5c9-49586e06d69e service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:50.827337 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-e6419595-74ee-4c29-8a00-f3e519f36ca2 req-6f4ce15d-e709-4490-b5c9-49586e06d69e service nova] Creating event network-changed:f2581f0d-52d5-4fd2-aac8-ba96fe0f65ed for instance ad12cd77-70c4-4d1b-a6c3-66ba546ad15a on hv-cinder-83608 Jun 07 14:25:50.832331 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-e6419595-74ee-4c29-8a00-f3e519f36ca2 req-6f4ce15d-e709-4490-b5c9-49586e06d69e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038759 Jun 07 14:25:50.832949 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 232/492] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:25:51.523180 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d1c3f370-6115-456b-95f9-5edb99b91968 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:51.524216 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-d1c3f370-6115-456b-95f9-5edb99b91968 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:51.530448 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d1c3f370-6115-456b-95f9-5edb99b91968 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:51.530980 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d1c3f370-6115-456b-95f9-5edb99b91968 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:51.531779 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d1c3f370-6115-456b-95f9-5edb99b91968 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:51.532212 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d1c3f370-6115-456b-95f9-5edb99b91968 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:51.666224 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-d1c3f370-6115-456b-95f9-5edb99b91968 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:51.673582 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-d1c3f370-6115-456b-95f9-5edb99b91968 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1356 microversion: 2.1 time: 0.155358 Jun 07 14:25:51.674146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 261/493] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:51 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1356 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:52.396414 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-46c40dd1-6c21-4f08-9443-36115ecee903 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:52.396987 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-46c40dd1-6c21-4f08-9443-36115ecee903 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 57975a90-732f-4014-b0eb-076c7acca1c9] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:52.403300 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-46c40dd1-6c21-4f08-9443-36115ecee903 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:52.403750 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-46c40dd1-6c21-4f08-9443-36115ecee903 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:52.404505 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-46c40dd1-6c21-4f08-9443-36115ecee903 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:52.404935 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-46c40dd1-6c21-4f08-9443-36115ecee903 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:52.531129 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-46c40dd1-6c21-4f08-9443-36115ecee903 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lazy-loading 'services' on Instance uuid 57975a90-732f-4014-b0eb-076c7acca1c9 {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:25:52.646235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-46c40dd1-6c21-4f08-9443-36115ecee903 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "DELETE /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9/os-volume_attachments/8a74f5b6-fe51-4229-a2c5-e8ebeef325b6" status: 202 len: 0 microversion: 2.1 time: 0.254368 Jun 07 14:25:52.646869 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 233/494] 10.222.0.81 () {58 vars in 1415 bytes} [Tue Jun 7 14:25:52 2022] DELETE /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9/os-volume_attachments/8a74f5b6-fe51-4229-a2c5-e8ebeef325b6 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:25:52.689791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-bf5a9462-ef5e-4ce8-a609-afcc98a4e76a tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:52.690444 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-bf5a9462-ef5e-4ce8-a609-afcc98a4e76a tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:52.701358 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bf5a9462-ef5e-4ce8-a609-afcc98a4e76a tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:52.703129 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bf5a9462-ef5e-4ce8-a609-afcc98a4e76a tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:52.704468 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bf5a9462-ef5e-4ce8-a609-afcc98a4e76a tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:52.707190 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bf5a9462-ef5e-4ce8-a609-afcc98a4e76a tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:53.082035 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-bf5a9462-ef5e-4ce8-a609-afcc98a4e76a tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:53.089936 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-bf5a9462-ef5e-4ce8-a609-afcc98a4e76a tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1356 microversion: 2.1 time: 0.403932 Jun 07 14:25:53.090508 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 262/495] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:52 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1356 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:54.107930 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3ab697e9-5b90-4f0e-8422-c69938a96706 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:54.108624 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3ab697e9-5b90-4f0e-8422-c69938a96706 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:54.115266 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3ab697e9-5b90-4f0e-8422-c69938a96706 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:54.115715 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3ab697e9-5b90-4f0e-8422-c69938a96706 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:54.117065 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3ab697e9-5b90-4f0e-8422-c69938a96706 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:54.117813 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3ab697e9-5b90-4f0e-8422-c69938a96706 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:54.250176 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3ab697e9-5b90-4f0e-8422-c69938a96706 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:54.257698 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3ab697e9-5b90-4f0e-8422-c69938a96706 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1356 microversion: 2.1 time: 0.154459 Jun 07 14:25:54.258273 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 234/496] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:54 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:55.274771 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-0bbc5fa9-792e-413f-9558-5754277d3044 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:55.275436 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-0bbc5fa9-792e-413f-9558-5754277d3044 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:55.281520 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0bbc5fa9-792e-413f-9558-5754277d3044 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:55.281961 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0bbc5fa9-792e-413f-9558-5754277d3044 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:55.282722 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0bbc5fa9-792e-413f-9558-5754277d3044 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:55.283152 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0bbc5fa9-792e-413f-9558-5754277d3044 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:55.415248 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-0bbc5fa9-792e-413f-9558-5754277d3044 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:55.422645 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-0bbc5fa9-792e-413f-9558-5754277d3044 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1356 microversion: 2.1 time: 0.152541 Jun 07 14:25:55.423204 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 263/497] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:55 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1356 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:25:56.440170 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2df4da52-fd88-4dd1-8055-cc7dcb26b18d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:56.440728 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2df4da52-fd88-4dd1-8055-cc7dcb26b18d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:56.447789 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2df4da52-fd88-4dd1-8055-cc7dcb26b18d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:56.448239 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2df4da52-fd88-4dd1-8055-cc7dcb26b18d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:56.449094 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2df4da52-fd88-4dd1-8055-cc7dcb26b18d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:56.449422 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2df4da52-fd88-4dd1-8055-cc7dcb26b18d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:56.583087 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2df4da52-fd88-4dd1-8055-cc7dcb26b18d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:56.591960 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2df4da52-fd88-4dd1-8055-cc7dcb26b18d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1356 microversion: 2.1 time: 0.155722 Jun 07 14:25:56.602014 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 235/498] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:56 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1356 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:56.672127 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-7a12422c-6c3d-47ef-8432-65fba1b79bef req-6313e611-1bd4-4e5e-b782-faeb38b3f741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad12cd77-70c4-4d1b-a6c3-66ba546ad15a", "name": "network-vif-plugged", "status": "completed", "tag": "f2581f0d-52d5-4fd2-aac8-ba96fe0f65ed"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:25:56.682178 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-7a12422c-6c3d-47ef-8432-65fba1b79bef req-6313e611-1bd4-4e5e-b782-faeb38b3f741 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:56.682178 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-7a12422c-6c3d-47ef-8432-65fba1b79bef req-6313e611-1bd4-4e5e-b782-faeb38b3f741 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:56.693598 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-7a12422c-6c3d-47ef-8432-65fba1b79bef req-6313e611-1bd4-4e5e-b782-faeb38b3f741 service nova] Creating event network-vif-plugged:f2581f0d-52d5-4fd2-aac8-ba96fe0f65ed for instance ad12cd77-70c4-4d1b-a6c3-66ba546ad15a on hv-cinder-83608 Jun 07 14:25:56.698687 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-7a12422c-6c3d-47ef-8432-65fba1b79bef req-6313e611-1bd4-4e5e-b782-faeb38b3f741 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030307 Jun 07 14:25:56.699310 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 264/499] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:25:57.001742 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7dcc3fa1-089d-4b0b-8589-b42457c78399 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:25:57.002952 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7dcc3fa1-089d-4b0b-8589-b42457c78399 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:57.009297 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7dcc3fa1-089d-4b0b-8589-b42457c78399 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:57.009777 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7dcc3fa1-089d-4b0b-8589-b42457c78399 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:57.010542 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7dcc3fa1-089d-4b0b-8589-b42457c78399 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:57.010981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7dcc3fa1-089d-4b0b-8589-b42457c78399 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:57.035131 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-7dcc3fa1-089d-4b0b-8589-b42457c78399 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lazy-loading 'flavor' on Instance uuid 2740b69b-07ea-4b16-ae3d-3b964bc65edd {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:25:57.163865 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7dcc3fa1-089d-4b0b-8589-b42457c78399 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "POST /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd/action" status: 200 len: 32 microversion: 2.1 time: 0.166213 Jun 07 14:25:57.165073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 236/500] 10.222.0.81 () {60 vars in 1277 bytes} [Tue Jun 7 14:25:56 2022] POST /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 14:25:57.174705 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-f27b61a4-399c-4ca9-8196-76a6906be17e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:57.175939 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-f27b61a4-399c-4ca9-8196-76a6906be17e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:57.182244 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f27b61a4-399c-4ca9-8196-76a6906be17e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:57.182694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f27b61a4-399c-4ca9-8196-76a6906be17e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:57.183627 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f27b61a4-399c-4ca9-8196-76a6906be17e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:57.184154 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f27b61a4-399c-4ca9-8196-76a6906be17e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:57.352414 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-f27b61a4-399c-4ca9-8196-76a6906be17e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:57.361607 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-f27b61a4-399c-4ca9-8196-76a6906be17e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.191094 Jun 07 14:25:57.362178 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 265/501] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:57 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:57.610001 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2cdce64c-df6b-4dad-a6a6-773481550350 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:57.610703 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2cdce64c-df6b-4dad-a6a6-773481550350 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:57.617702 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2cdce64c-df6b-4dad-a6a6-773481550350 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:57.618137 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2cdce64c-df6b-4dad-a6a6-773481550350 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:57.619527 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2cdce64c-df6b-4dad-a6a6-773481550350 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:57.620544 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2cdce64c-df6b-4dad-a6a6-773481550350 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:57.766088 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2cdce64c-df6b-4dad-a6a6-773481550350 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:57.778856 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2cdce64c-df6b-4dad-a6a6-773481550350 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1356 microversion: 2.1 time: 0.173426 Jun 07 14:25:57.784393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 237/502] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:57 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1356 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:58.008289 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d5a08feb-7fb4-4602-a79b-9144c090d1db tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:58.008801 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-d5a08feb-7fb4-4602-a79b-9144c090d1db tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 57975a90-732f-4014-b0eb-076c7acca1c9] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:58.014886 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d5a08feb-7fb4-4602-a79b-9144c090d1db tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:58.015367 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d5a08feb-7fb4-4602-a79b-9144c090d1db tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:58.016223 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d5a08feb-7fb4-4602-a79b-9144c090d1db tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:58.016600 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d5a08feb-7fb4-4602-a79b-9144c090d1db tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:58.041362 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-d5a08feb-7fb4-4602-a79b-9144c090d1db tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 57975a90-732f-4014-b0eb-076c7acca1c9] Going to try to terminate instance {{(pid=117565) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:25:58.074547 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:58.119681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-d5a08feb-7fb4-4602-a79b-9144c090d1db tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "DELETE /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9" status: 204 len: 0 microversion: 2.1 time: 0.115696 Jun 07 14:25:58.120261 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 266/503] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:25:58 2022] DELETE /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 14:25:58.128327 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-756bdae8-025a-4d2f-9189-d86827602b1c tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:58.128931 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-756bdae8-025a-4d2f-9189-d86827602b1c tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 57975a90-732f-4014-b0eb-076c7acca1c9] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:58.136163 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-756bdae8-025a-4d2f-9189-d86827602b1c tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:58.136735 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-756bdae8-025a-4d2f-9189-d86827602b1c tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:58.137546 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-756bdae8-025a-4d2f-9189-d86827602b1c tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:58.138036 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-756bdae8-025a-4d2f-9189-d86827602b1c tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:58.281560 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-756bdae8-025a-4d2f-9189-d86827602b1c tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:58.289378 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-756bdae8-025a-4d2f-9189-d86827602b1c tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9" status: 200 len: 1512 microversion: 2.1 time: 0.164911 Jun 07 14:25:58.289949 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 238/504] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:58 2022] GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9 => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:58.379053 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-627b189a-cc3e-4eb2-9da6-a097959760ee tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:58.379785 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-627b189a-cc3e-4eb2-9da6-a097959760ee tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:58.386515 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-627b189a-cc3e-4eb2-9da6-a097959760ee tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:58.386966 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-627b189a-cc3e-4eb2-9da6-a097959760ee tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:58.387765 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-627b189a-cc3e-4eb2-9da6-a097959760ee tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:58.388204 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-627b189a-cc3e-4eb2-9da6-a097959760ee tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:58.515730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-627b189a-cc3e-4eb2-9da6-a097959760ee tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:58.523636 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-627b189a-cc3e-4eb2-9da6-a097959760ee tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.148712 Jun 07 14:25:58.524194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 267/505] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:58 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:58.801179 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c167cc7d-b257-45a5-a49a-a726b659b4fd tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:58.801816 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c167cc7d-b257-45a5-a49a-a726b659b4fd tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:58.809164 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c167cc7d-b257-45a5-a49a-a726b659b4fd tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:58.809606 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c167cc7d-b257-45a5-a49a-a726b659b4fd tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:58.810355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c167cc7d-b257-45a5-a49a-a726b659b4fd tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:58.810784 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c167cc7d-b257-45a5-a49a-a726b659b4fd tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:58.936802 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c167cc7d-b257-45a5-a49a-a726b659b4fd tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:58.944040 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c167cc7d-b257-45a5-a49a-a726b659b4fd tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1356 microversion: 2.1 time: 0.146687 Jun 07 14:25:58.944639 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 239/506] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:58 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1356 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:59.305849 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-bb54adb2-4175-4807-91cb-8c138880fa20 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:59.306460 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-bb54adb2-4175-4807-91cb-8c138880fa20 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 57975a90-732f-4014-b0eb-076c7acca1c9] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:59.312491 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bb54adb2-4175-4807-91cb-8c138880fa20 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:59.312948 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bb54adb2-4175-4807-91cb-8c138880fa20 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:59.313766 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bb54adb2-4175-4807-91cb-8c138880fa20 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:59.314201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bb54adb2-4175-4807-91cb-8c138880fa20 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:59.443361 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-bb54adb2-4175-4807-91cb-8c138880fa20 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:59.451493 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-bb54adb2-4175-4807-91cb-8c138880fa20 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9" status: 200 len: 1512 microversion: 2.1 time: 0.149912 Jun 07 14:25:59.452059 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 268/507] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:59 2022] GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9 => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:59.540442 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1f85f29d-7379-4091-9c2e-0378d47e3367 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:59.541083 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1f85f29d-7379-4091-9c2e-0378d47e3367 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:59.547100 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1f85f29d-7379-4091-9c2e-0378d47e3367 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:59.547574 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1f85f29d-7379-4091-9c2e-0378d47e3367 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:59.548325 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1f85f29d-7379-4091-9c2e-0378d47e3367 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:59.548762 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1f85f29d-7379-4091-9c2e-0378d47e3367 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:59.673740 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1f85f29d-7379-4091-9c2e-0378d47e3367 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:25:59.681855 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1f85f29d-7379-4091-9c2e-0378d47e3367 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.145526 Jun 07 14:25:59.682417 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 240/508] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:59 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:25:59.961092 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-cf51a294-1563-4f47-982f-af3a3da19bfb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:25:59.961712 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-cf51a294-1563-4f47-982f-af3a3da19bfb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:25:59.967818 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cf51a294-1563-4f47-982f-af3a3da19bfb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:59.968269 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cf51a294-1563-4f47-982f-af3a3da19bfb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:25:59.969025 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cf51a294-1563-4f47-982f-af3a3da19bfb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:25:59.969461 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cf51a294-1563-4f47-982f-af3a3da19bfb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:00.110820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-cf51a294-1563-4f47-982f-af3a3da19bfb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:00.119004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-cf51a294-1563-4f47-982f-af3a3da19bfb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1546 microversion: 2.1 time: 0.161979 Jun 07 14:26:00.119603 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 269/509] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:25:59 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:00.135672 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f524415e-5ae5-4462-8c44-af9b2c287c12 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:00.136292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f524415e-5ae5-4462-8c44-af9b2c287c12 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:00.142791 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f524415e-5ae5-4462-8c44-af9b2c287c12 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:00.143269 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f524415e-5ae5-4462-8c44-af9b2c287c12 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:00.144040 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f524415e-5ae5-4462-8c44-af9b2c287c12 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:00.144477 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f524415e-5ae5-4462-8c44-af9b2c287c12 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:00.162801 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:00.274648 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f524415e-5ae5-4462-8c44-af9b2c287c12 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:00.282063 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f524415e-5ae5-4462-8c44-af9b2c287c12 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1546 microversion: 2.1 time: 0.150998 Jun 07 14:26:00.282637 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 241/510] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:00 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1546 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:26:00.298002 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3d9178e6-8436-46b9-9c79-a76eb545bf96 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:00.301617 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-3d9178e6-8436-46b9-9c79-a76eb545bf96 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:00.302376 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-3d9178e6-8436-46b9-9c79-a76eb545bf96 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Searching by: {'deleted': False, 'project_id': '1c7b98807cae4a75968ed946de9c92bb'} {{(pid=117565) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 07 14:26:00.309558 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3d9178e6-8436-46b9-9c79-a76eb545bf96 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:00.310136 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3d9178e6-8436-46b9-9c79-a76eb545bf96 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:00.310765 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3d9178e6-8436-46b9-9c79-a76eb545bf96 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:00.311198 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3d9178e6-8436-46b9-9c79-a76eb545bf96 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:00.403151 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.multi_cell_list [None req-3d9178e6-8436-46b9-9c79-a76eb545bf96 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117565) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 07 14:26:00.469365 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-55081d6a-095c-437f-935d-cc23f93702d2 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:00.470313 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-55081d6a-095c-437f-935d-cc23f93702d2 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 57975a90-732f-4014-b0eb-076c7acca1c9] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:00.477524 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-55081d6a-095c-437f-935d-cc23f93702d2 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:00.477905 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-55081d6a-095c-437f-935d-cc23f93702d2 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:00.478676 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-55081d6a-095c-437f-935d-cc23f93702d2 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:00.479104 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-55081d6a-095c-437f-935d-cc23f93702d2 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:00.498881 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-3d9178e6-8436-46b9-9c79-a76eb545bf96 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.204521 Jun 07 14:26:00.499731 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 270/511] 10.222.0.81 () {58 vars in 1124 bytes} [Tue Jun 7 14:26:00 2022] GET /compute/v2.1/servers => generated 342 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:26:00.509291 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-266aa642-33cc-4115-840d-58c0329c7297 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:00.509904 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-266aa642-33cc-4115-840d-58c0329c7297 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:00.515924 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-266aa642-33cc-4115-840d-58c0329c7297 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:00.516376 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-266aa642-33cc-4115-840d-58c0329c7297 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:00.517135 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-266aa642-33cc-4115-840d-58c0329c7297 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:00.517572 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-266aa642-33cc-4115-840d-58c0329c7297 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:00.667433 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-55081d6a-095c-437f-935d-cc23f93702d2 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:00.674939 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-55081d6a-095c-437f-935d-cc23f93702d2 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9" status: 200 len: 1512 microversion: 2.1 time: 0.209446 Jun 07 14:26:00.675377 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 242/512] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:00 2022] GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9 => generated 1512 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:26:00.695306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-266aa642-33cc-4115-840d-58c0329c7297 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:00.697808 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d7a55b0e-d104-4b0f-a301-f7d6b3b69c9e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:00.698724 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d7a55b0e-d104-4b0f-a301-f7d6b3b69c9e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:00.703102 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-266aa642-33cc-4115-840d-58c0329c7297 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1546 microversion: 2.1 time: 0.197377 Jun 07 14:26:00.703901 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 271/513] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:00 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1546 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:26:00.704532 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d7a55b0e-d104-4b0f-a301-f7d6b3b69c9e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:00.704986 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d7a55b0e-d104-4b0f-a301-f7d6b3b69c9e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:00.705795 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d7a55b0e-d104-4b0f-a301-f7d6b3b69c9e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:00.706233 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d7a55b0e-d104-4b0f-a301-f7d6b3b69c9e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:00.849399 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-d7a55b0e-d104-4b0f-a301-f7d6b3b69c9e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:00.858545 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d7a55b0e-d104-4b0f-a301-f7d6b3b69c9e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.164678 Jun 07 14:26:00.859536 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 243/514] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:00 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:26:01.146287 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-16c63068-7ab6-4e6e-8177-5c759f3b3e00 req-430110fa-e194-4415-bd10-712a9c595031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57975a90-732f-4014-b0eb-076c7acca1c9", "name": "network-vif-deleted", "tag": "ab8e8c1b-0b00-47d6-92e7-e25f91d3426f"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:26:01.158368 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-16c63068-7ab6-4e6e-8177-5c759f3b3e00 req-430110fa-e194-4415-bd10-712a9c595031 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:01.158827 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-16c63068-7ab6-4e6e-8177-5c759f3b3e00 req-430110fa-e194-4415-bd10-712a9c595031 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:01.171458 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-16c63068-7ab6-4e6e-8177-5c759f3b3e00 req-430110fa-e194-4415-bd10-712a9c595031 service nova] Creating event network-vif-deleted:ab8e8c1b-0b00-47d6-92e7-e25f91d3426f for instance 57975a90-732f-4014-b0eb-076c7acca1c9 on hv-cinder-83608 Jun 07 14:26:01.176511 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-16c63068-7ab6-4e6e-8177-5c759f3b3e00 req-430110fa-e194-4415-bd10-712a9c595031 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034862 Jun 07 14:26:01.177102 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 272/515] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:26:01.691830 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c4e17974-62e6-4d3c-be01-281e67f0b8de tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:01.692658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c4e17974-62e6-4d3c-be01-281e67f0b8de tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 57975a90-732f-4014-b0eb-076c7acca1c9] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:01.701480 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c4e17974-62e6-4d3c-be01-281e67f0b8de tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:01.701935 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c4e17974-62e6-4d3c-be01-281e67f0b8de tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:01.702712 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c4e17974-62e6-4d3c-be01-281e67f0b8de tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:01.703152 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c4e17974-62e6-4d3c-be01-281e67f0b8de tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:01.740218 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c4e17974-62e6-4d3c-be01-281e67f0b8de tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:01.740683 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c4e17974-62e6-4d3c-be01-281e67f0b8de tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:01.741208 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-c4e17974-62e6-4d3c-be01-281e67f0b8de tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lazy-loading 'fault' on Instance uuid 57975a90-732f-4014-b0eb-076c7acca1c9 {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:26:01.790702 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c4e17974-62e6-4d3c-be01-281e67f0b8de tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79357bc4bc0d4b8d9dd5b07a25510f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f9adafa99949b3b5f624c6ae7be57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:01.800717 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c4e17974-62e6-4d3c-be01-281e67f0b8de tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9" status: 200 len: 1308 microversion: 2.1 time: 0.112468 Jun 07 14:26:01.801734 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 244/516] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:01 2022] GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9 => generated 1308 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:01.876860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-550b3c43-f8de-437f-a25d-6b80316b923d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:01.877559 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-550b3c43-f8de-437f-a25d-6b80316b923d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:01.884515 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-550b3c43-f8de-437f-a25d-6b80316b923d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:01.884887 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-550b3c43-f8de-437f-a25d-6b80316b923d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:01.885650 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-550b3c43-f8de-437f-a25d-6b80316b923d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:01.886084 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-550b3c43-f8de-437f-a25d-6b80316b923d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:02.016233 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-550b3c43-f8de-437f-a25d-6b80316b923d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:02.024722 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-550b3c43-f8de-437f-a25d-6b80316b923d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.152184 Jun 07 14:26:02.025288 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 273/517] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:01 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:02.256225 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-efda9556-a9be-413d-8ca6-6bed835c803b tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62eaeda1-6250-42e2-bf8b-b1e4bf92b20c"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:26:02.257975 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-efda9556-a9be-413d-8ca6-6bed835c803b tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:02.264035 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-efda9556-a9be-413d-8ca6-6bed835c803b tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:02.264494 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-efda9556-a9be-413d-8ca6-6bed835c803b tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:02.265268 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-efda9556-a9be-413d-8ca6-6bed835c803b tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:02.265711 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-efda9556-a9be-413d-8ca6-6bed835c803b tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:02.498841 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-efda9556-a9be-413d-8ca6-6bed835c803b tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "POST /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246279 Jun 07 14:26:02.499700 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 245/518] 10.222.0.81 () {60 vars in 1322 bytes} [Tue Jun 7 14:26:02 2022] POST /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:26:02.818573 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-779f8518-7d6e-4935-876d-9ca21ae7f3f8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:02.819196 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-779f8518-7d6e-4935-876d-9ca21ae7f3f8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] [instance: 57975a90-732f-4014-b0eb-076c7acca1c9] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:02.825640 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-779f8518-7d6e-4935-876d-9ca21ae7f3f8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:02.826083 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-779f8518-7d6e-4935-876d-9ca21ae7f3f8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:02.826831 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-779f8518-7d6e-4935-876d-9ca21ae7f3f8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:02.827285 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-779f8518-7d6e-4935-876d-9ca21ae7f3f8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:02.840468 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-779f8518-7d6e-4935-876d-9ca21ae7f3f8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] HTTP exception thrown: Instance 57975a90-732f-4014-b0eb-076c7acca1c9 could not be found. Jun 07 14:26:02.842070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-779f8518-7d6e-4935-876d-9ca21ae7f3f8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Request method failure captured: Jun 07 14:26:02.842070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9 HTTP/1.1 Jun 07 14:26:02.842070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:26:02.842070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:26:02.842070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:26:02.842070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:26:02.842070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:26:02.842070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:26:02.842070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:26:02.842070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:26:02.842070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin19fOKd9l_9NNrH1DlyI4QUYgRzH-q45i7OJj8OIyxCuZ3PxdCt5SsD5yD4HlGbS9hu2WDNZ3EWXOM1yOOZoWOEINF99HjhMw0NaKwnNqxGg1Q-g8XradEz73bH6D2OBoj-u5KshuVcf-pFAGUbSOs4ywpzgOJWiXP1TgT89D7V8tv4 Jun 07 14:26:02.842070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:26:02.842070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:26:02.842070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:26:02.842070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:26:02.842070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:26:02.842070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:26:02.842070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: 59f9adafa99949b3b5f624c6ae7be57e Jun 07 14:26:02.842070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-VolumesSnapshotTestJSON-506481533 Jun 07 14:26:02.842070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:26:02.842070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:26:02.843809 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/59f9adafa99949b3b5f624c6ae7be57e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_59f9adafa99949b3b5f624c6ae7be57e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/59f9adafa99949b3b5f624c6ae7be57e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/59f9adafa99949b3b5f624c6ae7be57e"}]}] Jun 07 14:26:02.843809 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-VolumesSnapshotTestJSON-506481533 Jun 07 14:26:02.843809 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: 59f9adafa99949b3b5f624c6ae7be57e Jun 07 14:26:02.843809 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-506481533 Jun 07 14:26:02.843809 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-VolumesSnapshotTestJSON-506481533-project Jun 07 14:26:02.843809 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:26:02.843809 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:26:02.843809 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: 79357bc4bc0d4b8d9dd5b07a25510f3a Jun 07 14:26:02.843809 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-VolumesSnapshotTestJSON-506481533-project Jun 07 14:26:02.843809 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:26:02.843809 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance 57975a90-732f-4014-b0eb-076c7acca1c9 could not be found. Jun 07 14:26:02.843809 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': '57975a90-732f-4014-b0eb-076c7acca1c9'} Jun 07 14:26:02.844863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:26:02.844863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:26:02.844863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:26:02.844863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:26:02.844863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:26:02.844863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:26:02.844863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:26:02.844863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:26:02.844863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:26:02.844863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:26:02.844863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57975a90-732f-4014-b0eb-076c7acca1c9 could not be found. Jun 07 14:26:02.844863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:26:02.844863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:26:02.844863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:26:02.844863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:26:02.844863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:26:02.844863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:26:02.844863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:26:02.844863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:26:02.844863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:26:02.846176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:26:02.846176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:26:02.846176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:26:02.846176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:26:02.846176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:26:02.846176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:26:02.846176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:26:02.846176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57975a90-732f-4014-b0eb-076c7acca1c9 could not be found. Jun 07 14:26:02.846176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:26:02.846176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:26:02.846176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:26:02.846176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:26:02.846176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:26:02.846176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:26:02.846176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:26:02.846176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:26:02.846176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57975a90-732f-4014-b0eb-076c7acca1c9 could not be found. Jun 07 14:26:02.846176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:26:02.847521 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-779f8518-7d6e-4935-876d-9ca21ae7f3f8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] Returning 404 to user: Instance 57975a90-732f-4014-b0eb-076c7acca1c9 could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:26:02.847521 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-779f8518-7d6e-4935-876d-9ca21ae7f3f8 tempest-VolumesSnapshotTestJSON-506481533 tempest-VolumesSnapshotTestJSON-506481533-project] 10.222.0.81 "GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9" status: 404 len: 111 microversion: 2.1 time: 0.028735 Jun 07 14:26:02.847521 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 274/519] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:02 2022] GET /compute/v2.1/servers/57975a90-732f-4014-b0eb-076c7acca1c9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:26:03.043365 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1f9bbd29-cf06-44b8-86fc-b11e9a70a112 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:03.043991 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1f9bbd29-cf06-44b8-86fc-b11e9a70a112 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:03.050381 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1f9bbd29-cf06-44b8-86fc-b11e9a70a112 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:03.050828 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1f9bbd29-cf06-44b8-86fc-b11e9a70a112 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:03.051617 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1f9bbd29-cf06-44b8-86fc-b11e9a70a112 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:03.052050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1f9bbd29-cf06-44b8-86fc-b11e9a70a112 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:03.199743 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1f9bbd29-cf06-44b8-86fc-b11e9a70a112 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:03.208211 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1f9bbd29-cf06-44b8-86fc-b11e9a70a112 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.170388 Jun 07 14:26:03.208775 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 246/520] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:03 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:04.225960 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-c4c8d2d3-0e98-4805-96a5-119e25d72104 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:04.226685 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-c4c8d2d3-0e98-4805-96a5-119e25d72104 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:04.229265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:04.234878 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c4c8d2d3-0e98-4805-96a5-119e25d72104 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:04.235475 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c4c8d2d3-0e98-4805-96a5-119e25d72104 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:04.236144 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c4c8d2d3-0e98-4805-96a5-119e25d72104 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:04.236583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c4c8d2d3-0e98-4805-96a5-119e25d72104 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:04.377833 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-c4c8d2d3-0e98-4805-96a5-119e25d72104 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:04.385857 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-c4c8d2d3-0e98-4805-96a5-119e25d72104 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.163622 Jun 07 14:26:04.386356 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 275/521] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:04 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:05.403521 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1e78c75f-f369-4418-9d36-fb3fe4976642 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:05.404356 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1e78c75f-f369-4418-9d36-fb3fe4976642 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:05.406747 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:05.412068 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1e78c75f-f369-4418-9d36-fb3fe4976642 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:05.412520 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1e78c75f-f369-4418-9d36-fb3fe4976642 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:05.413277 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1e78c75f-f369-4418-9d36-fb3fe4976642 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:05.413718 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1e78c75f-f369-4418-9d36-fb3fe4976642 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:05.539893 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1e78c75f-f369-4418-9d36-fb3fe4976642 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:05.547848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1e78c75f-f369-4418-9d36-fb3fe4976642 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.148225 Jun 07 14:26:05.548416 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 247/522] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:05 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:06.565655 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-b9b94210-1297-4663-b45f-fcb291c5138b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:06.566299 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-b9b94210-1297-4663-b45f-fcb291c5138b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:06.573013 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b9b94210-1297-4663-b45f-fcb291c5138b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:06.573456 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b9b94210-1297-4663-b45f-fcb291c5138b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:06.574213 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b9b94210-1297-4663-b45f-fcb291c5138b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:06.574648 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b9b94210-1297-4663-b45f-fcb291c5138b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:06.703695 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-b9b94210-1297-4663-b45f-fcb291c5138b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:06.711499 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-b9b94210-1297-4663-b45f-fcb291c5138b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.149676 Jun 07 14:26:06.712393 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 276/523] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:06 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:07.729252 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-12f8ea35-0c4b-43c8-874a-b1b04e2d46fd tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:07.729771 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-12f8ea35-0c4b-43c8-874a-b1b04e2d46fd tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:07.736429 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-12f8ea35-0c4b-43c8-874a-b1b04e2d46fd tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:07.736876 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-12f8ea35-0c4b-43c8-874a-b1b04e2d46fd tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:07.737636 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-12f8ea35-0c4b-43c8-874a-b1b04e2d46fd tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:07.738067 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-12f8ea35-0c4b-43c8-874a-b1b04e2d46fd tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:07.866462 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-12f8ea35-0c4b-43c8-874a-b1b04e2d46fd tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:07.875133 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-12f8ea35-0c4b-43c8-874a-b1b04e2d46fd tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.150131 Jun 07 14:26:07.875726 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 248/524] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:07 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:08.895344 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-c4bc4708-e047-4f26-8423-aabf8078266e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:08.895956 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-c4bc4708-e047-4f26-8423-aabf8078266e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:08.904852 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c4bc4708-e047-4f26-8423-aabf8078266e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:08.905342 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c4bc4708-e047-4f26-8423-aabf8078266e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:08.906262 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c4bc4708-e047-4f26-8423-aabf8078266e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:08.906704 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c4bc4708-e047-4f26-8423-aabf8078266e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:09.037591 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-c4bc4708-e047-4f26-8423-aabf8078266e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:09.045840 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-c4bc4708-e047-4f26-8423-aabf8078266e tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.155841 Jun 07 14:26:09.046412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 277/525] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:08 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:10.045775 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6f81eec0-6a0d-45f9-b5f4-e00d4d0ca88e tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:10.046506 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-6f81eec0-6a0d-45f9-b5f4-e00d4d0ca88e tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:10.054034 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6f81eec0-6a0d-45f9-b5f4-e00d4d0ca88e tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:10.054473 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6f81eec0-6a0d-45f9-b5f4-e00d4d0ca88e tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:10.055874 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6f81eec0-6a0d-45f9-b5f4-e00d4d0ca88e tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:10.056311 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6f81eec0-6a0d-45f9-b5f4-e00d4d0ca88e tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:10.062134 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-888cd747-4f7b-429b-96bc-19db56bc1d68 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:10.062747 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-888cd747-4f7b-429b-96bc-19db56bc1d68 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:10.069963 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-888cd747-4f7b-429b-96bc-19db56bc1d68 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:10.070411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-888cd747-4f7b-429b-96bc-19db56bc1d68 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:10.071245 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-888cd747-4f7b-429b-96bc-19db56bc1d68 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:10.071762 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-888cd747-4f7b-429b-96bc-19db56bc1d68 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:10.266154 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-6f81eec0-6a0d-45f9-b5f4-e00d4d0ca88e tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:10.270054 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-888cd747-4f7b-429b-96bc-19db56bc1d68 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:10.275603 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6f81eec0-6a0d-45f9-b5f4-e00d4d0ca88e tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1592 microversion: 2.1 time: 0.233995 Jun 07 14:26:10.276544 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 249/526] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:10 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1592 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:10.278758 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-888cd747-4f7b-429b-96bc-19db56bc1d68 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.220679 Jun 07 14:26:10.279353 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 278/527] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:10 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:26:11.297007 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-4b46eb05-3466-46ed-9c20-00b85cf16b4f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:11.298119 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-4b46eb05-3466-46ed-9c20-00b85cf16b4f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:11.304830 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4b46eb05-3466-46ed-9c20-00b85cf16b4f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:11.305450 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4b46eb05-3466-46ed-9c20-00b85cf16b4f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:11.306229 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4b46eb05-3466-46ed-9c20-00b85cf16b4f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:11.306674 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4b46eb05-3466-46ed-9c20-00b85cf16b4f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:11.443317 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-4b46eb05-3466-46ed-9c20-00b85cf16b4f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:11.452176 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-4b46eb05-3466-46ed-9c20-00b85cf16b4f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.158975 Jun 07 14:26:11.452745 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 250/528] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:11 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:12.015676 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-244a3ea9-6af6-4c07-8514-9560093ad525 req-6c124364-03f2-44b2-a99c-950798447910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad12cd77-70c4-4d1b-a6c3-66ba546ad15a", "tag": "f2581f0d-52d5-4fd2-aac8-ba96fe0f65ed"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:26:12.033329 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=2 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:12.035835 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-244a3ea9-6af6-4c07-8514-9560093ad525 req-6c124364-03f2-44b2-a99c-950798447910 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:12.036282 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-244a3ea9-6af6-4c07-8514-9560093ad525 req-6c124364-03f2-44b2-a99c-950798447910 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:12.059906 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-244a3ea9-6af6-4c07-8514-9560093ad525 req-6c124364-03f2-44b2-a99c-950798447910 service nova] Creating event network-changed:f2581f0d-52d5-4fd2-aac8-ba96fe0f65ed for instance ad12cd77-70c4-4d1b-a6c3-66ba546ad15a on hv-cinder-83608 Jun 07 14:26:12.065317 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-244a3ea9-6af6-4c07-8514-9560093ad525 req-6c124364-03f2-44b2-a99c-950798447910 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053376 Jun 07 14:26:12.066199 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 279/529] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:26:12.469788 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6db37b20-5667-43bd-a5cf-f5183559efe5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:12.470443 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-6db37b20-5667-43bd-a5cf-f5183559efe5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:12.477891 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6db37b20-5667-43bd-a5cf-f5183559efe5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:12.478256 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6db37b20-5667-43bd-a5cf-f5183559efe5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:12.479045 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6db37b20-5667-43bd-a5cf-f5183559efe5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:12.479515 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6db37b20-5667-43bd-a5cf-f5183559efe5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:12.724631 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-6db37b20-5667-43bd-a5cf-f5183559efe5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:12.771621 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6db37b20-5667-43bd-a5cf-f5183559efe5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.305894 Jun 07 14:26:12.772693 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 251/530] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:12 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:13.281194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d8f31a2f-7a5b-4f86-962f-5e1afbfe5b4f tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1835077111"}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:26:13.281820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-d8f31a2f-7a5b-4f86-962f-5e1afbfe5b4f tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:13.288064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d8f31a2f-7a5b-4f86-962f-5e1afbfe5b4f tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:13.288547 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d8f31a2f-7a5b-4f86-962f-5e1afbfe5b4f tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:13.289364 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d8f31a2f-7a5b-4f86-962f-5e1afbfe5b4f tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:13.290526 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d8f31a2f-7a5b-4f86-962f-5e1afbfe5b4f tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:13.415778 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.network.security_group_api [None req-d8f31a2f-7a5b-4f86-962f-5e1afbfe5b4f tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Adding security group 260e07c0-80f5-42e0-86b3-50d346f3c11d to port f2581f0d-52d5-4fd2-aac8-ba96fe0f65ed Jun 07 14:26:13.790191 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2e017494-df44-451d-97b6-d3921f54c6b8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:13.791043 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2e017494-df44-451d-97b6-d3921f54c6b8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:13.799047 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2e017494-df44-451d-97b6-d3921f54c6b8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:13.799659 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2e017494-df44-451d-97b6-d3921f54c6b8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:13.800503 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2e017494-df44-451d-97b6-d3921f54c6b8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:13.801052 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2e017494-df44-451d-97b6-d3921f54c6b8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:13.807756 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-d8f31a2f-7a5b-4f86-962f-5e1afbfe5b4f tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "POST /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/action" status: 202 len: 0 microversion: 2.1 time: 0.530778 Jun 07 14:26:13.808376 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 280/531] 10.222.0.81 () {60 vars in 1277 bytes} [Tue Jun 7 14:26:13 2022] POST /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:26:13.816636 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-000ffdd9-84b1-43bc-9701-e1ad1ece3eeb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:13.817440 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-000ffdd9-84b1-43bc-9701-e1ad1ece3eeb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:13.824371 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-000ffdd9-84b1-43bc-9701-e1ad1ece3eeb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:13.824825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-000ffdd9-84b1-43bc-9701-e1ad1ece3eeb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:13.825597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-000ffdd9-84b1-43bc-9701-e1ad1ece3eeb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:13.826111 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-000ffdd9-84b1-43bc-9701-e1ad1ece3eeb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:14.013785 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2e017494-df44-451d-97b6-d3921f54c6b8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:14.022807 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2e017494-df44-451d-97b6-d3921f54c6b8 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.237359 Jun 07 14:26:14.023412 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 252/532] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:13 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:14.028344 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-c78edef4-0b50-4a06-811a-2391f53557b4 req-2322975c-4ab2-4eb6-bf2a-1799662435e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad12cd77-70c4-4d1b-a6c3-66ba546ad15a", "tag": "f2581f0d-52d5-4fd2-aac8-ba96fe0f65ed"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:26:14.036104 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-c78edef4-0b50-4a06-811a-2391f53557b4 req-2322975c-4ab2-4eb6-bf2a-1799662435e3 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:14.036543 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-c78edef4-0b50-4a06-811a-2391f53557b4 req-2322975c-4ab2-4eb6-bf2a-1799662435e3 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:14.042454 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-000ffdd9-84b1-43bc-9701-e1ad1ece3eeb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:14.048132 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-c78edef4-0b50-4a06-811a-2391f53557b4 req-2322975c-4ab2-4eb6-bf2a-1799662435e3 service nova] Creating event network-changed:f2581f0d-52d5-4fd2-aac8-ba96fe0f65ed for instance ad12cd77-70c4-4d1b-a6c3-66ba546ad15a on hv-cinder-83608 Jun 07 14:26:14.050886 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-000ffdd9-84b1-43bc-9701-e1ad1ece3eeb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1758 microversion: 2.1 time: 0.238009 Jun 07 14:26:14.051490 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 281/533] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:13 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1758 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:14.053427 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-c78edef4-0b50-4a06-811a-2391f53557b4 req-2322975c-4ab2-4eb6-bf2a-1799662435e3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028890 Jun 07 14:26:14.054004 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 253/534] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:26:15.040484 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-07528488-1091-446c-9fec-69ec29461741 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:15.042299 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-07528488-1091-446c-9fec-69ec29461741 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:15.047278 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-07528488-1091-446c-9fec-69ec29461741 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:15.047732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-07528488-1091-446c-9fec-69ec29461741 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:15.048493 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-07528488-1091-446c-9fec-69ec29461741 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:15.048930 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-07528488-1091-446c-9fec-69ec29461741 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:15.176029 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-07528488-1091-446c-9fec-69ec29461741 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:15.184535 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-07528488-1091-446c-9fec-69ec29461741 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.148396 Jun 07 14:26:15.185096 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 282/535] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:15 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:16.202306 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f7bc1d74-0808-4f30-9c87-1fd8011a5160 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:16.202997 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f7bc1d74-0808-4f30-9c87-1fd8011a5160 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:16.209549 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f7bc1d74-0808-4f30-9c87-1fd8011a5160 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:16.209991 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f7bc1d74-0808-4f30-9c87-1fd8011a5160 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:16.210754 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f7bc1d74-0808-4f30-9c87-1fd8011a5160 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:16.211248 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f7bc1d74-0808-4f30-9c87-1fd8011a5160 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:16.346428 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f7bc1d74-0808-4f30-9c87-1fd8011a5160 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:16.354347 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f7bc1d74-0808-4f30-9c87-1fd8011a5160 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.156213 Jun 07 14:26:16.354922 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 254/536] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:16 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:17.370798 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d2cf5a5b-37a0-4b18-bd6d-6b8f4320630b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:17.371433 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-d2cf5a5b-37a0-4b18-bd6d-6b8f4320630b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:17.377363 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d2cf5a5b-37a0-4b18-bd6d-6b8f4320630b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:17.377808 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d2cf5a5b-37a0-4b18-bd6d-6b8f4320630b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:17.378560 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d2cf5a5b-37a0-4b18-bd6d-6b8f4320630b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:17.378996 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d2cf5a5b-37a0-4b18-bd6d-6b8f4320630b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:17.507354 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-d2cf5a5b-37a0-4b18-bd6d-6b8f4320630b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:17.515960 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-d2cf5a5b-37a0-4b18-bd6d-6b8f4320630b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.149302 Jun 07 14:26:17.516523 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 283/537] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:17 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:18.532732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1eb3aac4-0bad-4496-94ad-7466a4a4035d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:18.533338 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1eb3aac4-0bad-4496-94ad-7466a4a4035d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:18.539854 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1eb3aac4-0bad-4496-94ad-7466a4a4035d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:18.541268 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1eb3aac4-0bad-4496-94ad-7466a4a4035d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:18.542052 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1eb3aac4-0bad-4496-94ad-7466a4a4035d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:18.542487 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1eb3aac4-0bad-4496-94ad-7466a4a4035d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:18.672172 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1eb3aac4-0bad-4496-94ad-7466a4a4035d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:18.680313 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1eb3aac4-0bad-4496-94ad-7466a4a4035d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.151431 Jun 07 14:26:18.681104 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 255/538] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:18 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:19.698021 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-1e16e242-33fb-4b84-8b3c-f63b9253a3cb tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:19.698627 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-1e16e242-33fb-4b84-8b3c-f63b9253a3cb tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:19.704582 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1e16e242-33fb-4b84-8b3c-f63b9253a3cb tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:19.705026 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1e16e242-33fb-4b84-8b3c-f63b9253a3cb tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:19.705772 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1e16e242-33fb-4b84-8b3c-f63b9253a3cb tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:19.706200 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1e16e242-33fb-4b84-8b3c-f63b9253a3cb tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:19.832685 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-1e16e242-33fb-4b84-8b3c-f63b9253a3cb tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:19.836180 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:19.842738 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-1e16e242-33fb-4b84-8b3c-f63b9253a3cb tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.148860 Jun 07 14:26:19.843329 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 284/539] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:19 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:20.860146 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-4939336e-f279-40f0-b64b-0c065dbbefd0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:20.860748 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-4939336e-f279-40f0-b64b-0c065dbbefd0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:20.867192 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4939336e-f279-40f0-b64b-0c065dbbefd0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:20.867667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4939336e-f279-40f0-b64b-0c065dbbefd0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:20.868420 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4939336e-f279-40f0-b64b-0c065dbbefd0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:20.869697 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4939336e-f279-40f0-b64b-0c065dbbefd0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:21.124118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-4939336e-f279-40f0-b64b-0c065dbbefd0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:21.131912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-4939336e-f279-40f0-b64b-0c065dbbefd0 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.275635 Jun 07 14:26:21.132473 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 256/540] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:20 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:22.148331 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-6d42c54e-b989-4660-9415-bb975fd2b5aa tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:22.148933 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-6d42c54e-b989-4660-9415-bb975fd2b5aa tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:22.156573 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6d42c54e-b989-4660-9415-bb975fd2b5aa tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:22.157023 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6d42c54e-b989-4660-9415-bb975fd2b5aa tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:22.157790 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6d42c54e-b989-4660-9415-bb975fd2b5aa tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:22.158220 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6d42c54e-b989-4660-9415-bb975fd2b5aa tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:22.340869 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-6d42c54e-b989-4660-9415-bb975fd2b5aa tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:22.349133 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-6d42c54e-b989-4660-9415-bb975fd2b5aa tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.204641 Jun 07 14:26:22.349727 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 285/541] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:22 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:23.366958 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a5da9fb4-525d-4015-a6f5-e34481b505db tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:23.367590 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a5da9fb4-525d-4015-a6f5-e34481b505db tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:23.374543 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a5da9fb4-525d-4015-a6f5-e34481b505db tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:23.374987 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a5da9fb4-525d-4015-a6f5-e34481b505db tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:23.376270 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a5da9fb4-525d-4015-a6f5-e34481b505db tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:23.376698 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a5da9fb4-525d-4015-a6f5-e34481b505db tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:23.380795 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:23.514537 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a5da9fb4-525d-4015-a6f5-e34481b505db tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:23.522444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a5da9fb4-525d-4015-a6f5-e34481b505db tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.160196 Jun 07 14:26:23.523011 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 257/542] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:23 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:24.539977 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-807f6c43-5485-4efe-a85f-bafc27211d29 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:24.540584 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-807f6c43-5485-4efe-a85f-bafc27211d29 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:24.547537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-807f6c43-5485-4efe-a85f-bafc27211d29 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:24.547984 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-807f6c43-5485-4efe-a85f-bafc27211d29 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:24.548734 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-807f6c43-5485-4efe-a85f-bafc27211d29 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:24.549167 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-807f6c43-5485-4efe-a85f-bafc27211d29 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:24.680101 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-807f6c43-5485-4efe-a85f-bafc27211d29 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:24.688095 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-807f6c43-5485-4efe-a85f-bafc27211d29 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.151968 Jun 07 14:26:24.688688 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 286/543] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:24 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:25.704382 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-98d091fb-ddc2-4edb-9569-db2bc55000ae tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:25.704930 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-98d091fb-ddc2-4edb-9569-db2bc55000ae tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:25.711402 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-98d091fb-ddc2-4edb-9569-db2bc55000ae tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:25.711858 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-98d091fb-ddc2-4edb-9569-db2bc55000ae tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:25.712624 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-98d091fb-ddc2-4edb-9569-db2bc55000ae tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:25.713066 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-98d091fb-ddc2-4edb-9569-db2bc55000ae tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:25.845812 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-98d091fb-ddc2-4edb-9569-db2bc55000ae tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:25.853793 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-98d091fb-ddc2-4edb-9569-db2bc55000ae tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.153333 Jun 07 14:26:25.854377 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 258/544] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:25 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:26.871710 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3b805035-af09-4854-bf7f-953b01b8b70a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:26.872329 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-3b805035-af09-4854-bf7f-953b01b8b70a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:26.878370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3b805035-af09-4854-bf7f-953b01b8b70a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:26.878818 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3b805035-af09-4854-bf7f-953b01b8b70a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:26.879608 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3b805035-af09-4854-bf7f-953b01b8b70a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:26.880040 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3b805035-af09-4854-bf7f-953b01b8b70a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:27.036610 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-3b805035-af09-4854-bf7f-953b01b8b70a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:27.046583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-3b805035-af09-4854-bf7f-953b01b8b70a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.178810 Jun 07 14:26:27.047733 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 287/545] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:26 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:28.064415 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-67784611-0970-42a8-9c86-eb42a151b946 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:28.064962 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-67784611-0970-42a8-9c86-eb42a151b946 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:28.073851 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-67784611-0970-42a8-9c86-eb42a151b946 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:28.073851 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-67784611-0970-42a8-9c86-eb42a151b946 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:28.073851 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-67784611-0970-42a8-9c86-eb42a151b946 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:28.073851 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-67784611-0970-42a8-9c86-eb42a151b946 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:28.281855 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-67784611-0970-42a8-9c86-eb42a151b946 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:28.290342 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-67784611-0970-42a8-9c86-eb42a151b946 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.230177 Jun 07 14:26:28.290918 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 259/546] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:28 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:29.309848 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ea98ff9c-4cbd-4741-93f6-15d3a03a0ede tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:29.310460 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ea98ff9c-4cbd-4741-93f6-15d3a03a0ede tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:29.316655 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ea98ff9c-4cbd-4741-93f6-15d3a03a0ede tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:29.317107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ea98ff9c-4cbd-4741-93f6-15d3a03a0ede tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:29.317875 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ea98ff9c-4cbd-4741-93f6-15d3a03a0ede tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:29.318315 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ea98ff9c-4cbd-4741-93f6-15d3a03a0ede tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:29.654129 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ea98ff9c-4cbd-4741-93f6-15d3a03a0ede tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:29.661991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ea98ff9c-4cbd-4741-93f6-15d3a03a0ede tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.356651 Jun 07 14:26:29.662558 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 288/547] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:29 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:30.679385 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6ba5b8c5-70d0-4a3d-b4b6-8a19758ed5e2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:30.680665 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-6ba5b8c5-70d0-4a3d-b4b6-8a19758ed5e2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:30.687635 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6ba5b8c5-70d0-4a3d-b4b6-8a19758ed5e2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:30.688902 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6ba5b8c5-70d0-4a3d-b4b6-8a19758ed5e2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:30.690319 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6ba5b8c5-70d0-4a3d-b4b6-8a19758ed5e2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:30.690999 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6ba5b8c5-70d0-4a3d-b4b6-8a19758ed5e2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:30.948739 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-6ba5b8c5-70d0-4a3d-b4b6-8a19758ed5e2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:30.958754 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6ba5b8c5-70d0-4a3d-b4b6-8a19758ed5e2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.283103 Jun 07 14:26:30.959570 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 260/548] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:30 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:31.977686 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-afe8c968-691d-41e9-adef-4ee3bf118707 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:31.978224 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-afe8c968-691d-41e9-adef-4ee3bf118707 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:31.989397 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-afe8c968-691d-41e9-adef-4ee3bf118707 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:31.989858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-afe8c968-691d-41e9-adef-4ee3bf118707 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:31.990646 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-afe8c968-691d-41e9-adef-4ee3bf118707 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:31.991087 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-afe8c968-691d-41e9-adef-4ee3bf118707 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:32.333396 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-afe8c968-691d-41e9-adef-4ee3bf118707 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:32.342300 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-afe8c968-691d-41e9-adef-4ee3bf118707 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.368644 Jun 07 14:26:32.343248 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 289/549] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:31 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:33.360006 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f70ad9db-2e61-4465-be21-30bdd2cd0df5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:33.360734 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f70ad9db-2e61-4465-be21-30bdd2cd0df5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:33.367425 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f70ad9db-2e61-4465-be21-30bdd2cd0df5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:33.368002 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f70ad9db-2e61-4465-be21-30bdd2cd0df5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:33.368847 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f70ad9db-2e61-4465-be21-30bdd2cd0df5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:33.369404 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f70ad9db-2e61-4465-be21-30bdd2cd0df5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:33.542987 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f70ad9db-2e61-4465-be21-30bdd2cd0df5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:33.552834 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f70ad9db-2e61-4465-be21-30bdd2cd0df5 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1732 microversion: 2.1 time: 0.196795 Jun 07 14:26:33.553497 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 261/550] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:33 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1732 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:34.569893 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-2e613768-4f94-4f54-8582-3bfb1f08f16d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:34.570499 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-2e613768-4f94-4f54-8582-3bfb1f08f16d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:34.572417 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=30 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:34.578257 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2e613768-4f94-4f54-8582-3bfb1f08f16d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:34.585258 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2e613768-4f94-4f54-8582-3bfb1f08f16d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:34.587557 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2e613768-4f94-4f54-8582-3bfb1f08f16d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:34.588047 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2e613768-4f94-4f54-8582-3bfb1f08f16d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:34.819148 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-2e613768-4f94-4f54-8582-3bfb1f08f16d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:34.829335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-2e613768-4f94-4f54-8582-3bfb1f08f16d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1712 microversion: 2.1 time: 0.263135 Jun 07 14:26:34.830281 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 290/551] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:34 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1712 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:34.968990 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c307604b-bd25-40f3-885d-27de659a9e61 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:34.969986 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c307604b-bd25-40f3-885d-27de659a9e61 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:34.981983 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c307604b-bd25-40f3-885d-27de659a9e61 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:34.985031 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c307604b-bd25-40f3-885d-27de659a9e61 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:34.986072 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c307604b-bd25-40f3-885d-27de659a9e61 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:34.986693 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c307604b-bd25-40f3-885d-27de659a9e61 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:35.127523 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-c307604b-bd25-40f3-885d-27de659a9e61 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] HTTP exception thrown: Cannot 'detach_volume' instance 2740b69b-07ea-4b16-ae3d-3b964bc65edd while it is in vm_state rescued Jun 07 14:26:35.129204 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c307604b-bd25-40f3-885d-27de659a9e61 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Request method failure captured: Jun 07 14:26:35.129204 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: request: DELETE /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd/os-volume_attachments/4b86732f-24bd-4813-91d4-7eef0779dd78 HTTP/1.1 Jun 07 14:26:35.129204 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 07 14:26:35.129204 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 07 14:26:35.129204 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Connection: close Jun 07 14:26:35.129204 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 07 14:26:35.129204 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 07 14:26:35.129204 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Host: 10.222.0.81 Jun 07 14:26:35.129204 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 07 14:26:35.129204 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 07 14:26:35.129204 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABin17phWIJ_eQLsN9FOFsHWkCoa6NydW99S4V4yhx6nzXRUhevbmuM6FHueSJUBAhq0lRznadD50RBaf_KCwvLxd5hok2blY9CUWxTTfms_YMLnlhwe8EVLpd2UFPRe-bhvJMSOHgvXQUvrD7rxrLP2RKctJbF_rKq76mqAGT8baB5Tpo Jun 07 14:26:35.129204 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 07 14:26:35.129204 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 07 14:26:35.129204 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 07 14:26:35.129204 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 07 14:26:35.129204 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 07 14:26:35.129204 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 07 14:26:35.129204 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Id: ec8e48464f6a4d1886aaf89cc8b28e5f Jun 07 14:26:35.129204 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-444301016 Jun 07 14:26:35.129204 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Role: member,reader Jun 07 14:26:35.129204 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Roles: member,reader Jun 07 14:26:35.130822 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ec8e48464f6a4d1886aaf89cc8b28e5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ec8e48464f6a4d1886aaf89cc8b28e5f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ec8e48464f6a4d1886aaf89cc8b28e5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ec8e48464f6a4d1886aaf89cc8b28e5f"}]}] Jun 07 14:26:35.130822 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-ServerRescueNegativeTestJSON-444301016 Jun 07 14:26:35.130822 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Id: ec8e48464f6a4d1886aaf89cc8b28e5f Jun 07 14:26:35.130822 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-444301016 Jun 07 14:26:35.130822 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User: tempest-ServerRescueNegativeTestJSON-444301016-project Jun 07 14:26:35.130822 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 07 14:26:35.130822 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 07 14:26:35.130822 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Id: d20025ab12f4450da20c8e41b931b5fc Jun 07 14:26:35.130822 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-ServerRescueNegativeTestJSON-444301016-project Jun 07 14:26:35.130822 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: method: > Jun 07 14:26:35.130822 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: exception: Cannot 'detach_volume' instance 2740b69b-07ea-4b16-ae3d-3b964bc65edd while it is in vm_state rescued Jun 07 14:26:35.131705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: action_args: {'server_id': '2740b69b-07ea-4b16-ae3d-3b964bc65edd', 'id': '4b86732f-24bd-4813-91d4-7eef0779dd78'} Jun 07 14:26:35.131705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:26:35.131705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:26:35.131705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 07 14:26:35.131705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 07 14:26:35.131705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 14:26:35.131705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 14:26:35.131705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 07 14:26:35.131705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 07 14:26:35.131705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2740b69b-07ea-4b16-ae3d-3b964bc65edd in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 07 14:26:35.131705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:26:35.131705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:26:35.131705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:26:35.131705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:26:35.131705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:26:35.131705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:26:35.131705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:26:35.131705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:26:35.131705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:26:35.131705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:26:35.133303 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 07 14:26:35.133303 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 07 14:26:35.133303 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 07 14:26:35.133303 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 07 14:26:35.133303 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 2740b69b-07ea-4b16-ae3d-3b964bc65edd while it is in vm_state rescued Jun 07 14:26:35.133303 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:26:35.133303 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:26:35.133303 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:26:35.133303 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:26:35.133303 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:26:35.133303 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:26:35.133303 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:26:35.133303 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:26:35.133303 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 2740b69b-07ea-4b16-ae3d-3b964bc65edd while it is in vm_state rescued Jun 07 14:26:35.133303 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:26:35.135508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c307604b-bd25-40f3-885d-27de659a9e61 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Returning 409 to user: Cannot 'detach_volume' instance 2740b69b-07ea-4b16-ae3d-3b964bc65edd while it is in vm_state rescued {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:26:35.136683 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c307604b-bd25-40f3-885d-27de659a9e61 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "DELETE /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd/os-volume_attachments/4b86732f-24bd-4813-91d4-7eef0779dd78" status: 409 len: 152 microversion: 2.1 time: 0.172635 Jun 07 14:26:35.137801 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 262/552] 10.222.0.81 () {58 vars in 1415 bytes} [Tue Jun 7 14:26:34 2022] DELETE /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd/os-volume_attachments/4b86732f-24bd-4813-91d4-7eef0779dd78 => generated 152 bytes in 175 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 07 14:26:35.146912 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-007cb072-52d0-442b-8c2b-875aac5c6877 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:26:35.147713 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-007cb072-52d0-442b-8c2b-875aac5c6877 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:35.160947 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-007cb072-52d0-442b-8c2b-875aac5c6877 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:35.161659 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-007cb072-52d0-442b-8c2b-875aac5c6877 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:35.164395 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-007cb072-52d0-442b-8c2b-875aac5c6877 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:35.165320 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-007cb072-52d0-442b-8c2b-875aac5c6877 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:35.278293 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-007cb072-52d0-442b-8c2b-875aac5c6877 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "POST /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd/action" status: 202 len: 0 microversion: 2.1 time: 0.130334 Jun 07 14:26:35.278949 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 291/553] 10.222.0.81 () {60 vars in 1277 bytes} [Tue Jun 7 14:26:35 2022] POST /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:26:35.294137 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-87310eaf-8c99-4f1e-81e2-74cae151e945 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:35.295944 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-87310eaf-8c99-4f1e-81e2-74cae151e945 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:35.310732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-87310eaf-8c99-4f1e-81e2-74cae151e945 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:35.317763 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-87310eaf-8c99-4f1e-81e2-74cae151e945 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:35.319048 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-87310eaf-8c99-4f1e-81e2-74cae151e945 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:35.322509 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-87310eaf-8c99-4f1e-81e2-74cae151e945 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:35.710722 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-87310eaf-8c99-4f1e-81e2-74cae151e945 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:35.721801 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-87310eaf-8c99-4f1e-81e2-74cae151e945 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1720 microversion: 2.1 time: 0.438238 Jun 07 14:26:35.734814 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 263/554] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:35 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1720 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:36.743883 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-5f9cf648-affd-4627-9f36-51b4cd47efcc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:36.744594 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-5f9cf648-affd-4627-9f36-51b4cd47efcc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:36.768963 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5f9cf648-affd-4627-9f36-51b4cd47efcc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:36.770544 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5f9cf648-affd-4627-9f36-51b4cd47efcc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:36.771623 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5f9cf648-affd-4627-9f36-51b4cd47efcc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:36.772228 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5f9cf648-affd-4627-9f36-51b4cd47efcc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:37.098451 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-5f9cf648-affd-4627-9f36-51b4cd47efcc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:37.108172 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-5f9cf648-affd-4627-9f36-51b4cd47efcc tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1720 microversion: 2.1 time: 0.369671 Jun 07 14:26:37.109522 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 292/555] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:36 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1720 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:38.121926 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-feb8443e-771e-4172-85f1-eaa91c7492ee tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Action: 'create', calling method: .version_select at 0x7ff37f431940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-234910173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5xPjxNGfNK7RzANIYn67eXMXY3fRs+M82izmnnCEVh3awArjzU8HYvacNql+2/QzRR8MfgI6VpL9pBAxC5Tpj/r00EFvgGoFQd/pI8B6eQ/pcXb7wPVls0H346tfpVBQ=="}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:26:38.125977 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=34 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:38.126539 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ae8ea004-4646-4e7d-a193-7c987445f172 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:38.127356 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ae8ea004-4646-4e7d-a193-7c987445f172 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:38.133833 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ae8ea004-4646-4e7d-a193-7c987445f172 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:38.134508 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ae8ea004-4646-4e7d-a193-7c987445f172 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:38.135297 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ae8ea004-4646-4e7d-a193-7c987445f172 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:38.135733 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ae8ea004-4646-4e7d-a193-7c987445f172 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:38.138414 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-feb8443e-771e-4172-85f1-eaa91c7492ee tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Getting quotas for project 6ee52855d08e467f9d2f02685d7bf541. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:26:38.142428 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-feb8443e-771e-4172-85f1-eaa91c7492ee tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Getting quotas for user d0b828a3dca14f2283a16894364d6eef and project 6ee52855d08e467f9d2f02685d7bf541. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:26:38.172360 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-feb8443e-771e-4172-85f1-eaa91c7492ee tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.219045 Jun 07 14:26:38.173558 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 264/556] 10.222.0.81 () {60 vars in 1158 bytes} [Tue Jun 7 14:26:37 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:26:38.277640 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ae8ea004-4646-4e7d-a193-7c987445f172 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:38.287125 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ae8ea004-4646-4e7d-a193-7c987445f172 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1720 microversion: 2.1 time: 0.164050 Jun 07 14:26:38.287988 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 293/557] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:38 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:26:39.306045 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e1941b7f-3b5a-42ec-88cd-0183074eac55 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:39.306668 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e1941b7f-3b5a-42ec-88cd-0183074eac55 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:39.313973 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e1941b7f-3b5a-42ec-88cd-0183074eac55 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:39.314424 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e1941b7f-3b5a-42ec-88cd-0183074eac55 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:39.315825 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e1941b7f-3b5a-42ec-88cd-0183074eac55 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:39.316274 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e1941b7f-3b5a-42ec-88cd-0183074eac55 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:39.468040 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e1941b7f-3b5a-42ec-88cd-0183074eac55 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:39.477079 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e1941b7f-3b5a-42ec-88cd-0183074eac55 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1726 microversion: 2.1 time: 0.176095 Jun 07 14:26:39.477835 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 265/558] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:39 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:39.494324 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-a9f955dc-78a7-49d4-8f1b-04234c8f1bba tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:39.495391 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-a9f955dc-78a7-49d4-8f1b-04234c8f1bba tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:39.503137 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a9f955dc-78a7-49d4-8f1b-04234c8f1bba tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:39.503841 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a9f955dc-78a7-49d4-8f1b-04234c8f1bba tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:39.504622 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a9f955dc-78a7-49d4-8f1b-04234c8f1bba tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:39.505052 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a9f955dc-78a7-49d4-8f1b-04234c8f1bba tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:39.591988 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-a9f955dc-78a7-49d4-8f1b-04234c8f1bba tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101699 Jun 07 14:26:39.592577 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 294/559] 10.222.0.81 () {58 vars in 1274 bytes} [Tue Jun 7 14:26:39 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:26:39.827349 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d4a70da9-e451-4f8f-b171-8ce3b2a4fef6 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:26:39.828327 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d4a70da9-e451-4f8f-b171-8ce3b2a4fef6 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:39.837462 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d4a70da9-e451-4f8f-b171-8ce3b2a4fef6 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:39.838027 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d4a70da9-e451-4f8f-b171-8ce3b2a4fef6 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:39.838706 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d4a70da9-e451-4f8f-b171-8ce3b2a4fef6 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:39.839149 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d4a70da9-e451-4f8f-b171-8ce3b2a4fef6 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:39.971146 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d4a70da9-e451-4f8f-b171-8ce3b2a4fef6 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "POST /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/action" status: 202 len: 0 microversion: 2.1 time: 0.147603 Jun 07 14:26:39.972957 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 266/560] 10.222.0.81 () {60 vars in 1277 bytes} [Tue Jun 7 14:26:39 2022] POST /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:26:39.981322 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7d725a97-cdac-47c5-b832-a4cb0c5fd8aa tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:39.982060 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-7d725a97-cdac-47c5-b832-a4cb0c5fd8aa tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:40.001133 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7d725a97-cdac-47c5-b832-a4cb0c5fd8aa tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:40.002144 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7d725a97-cdac-47c5-b832-a4cb0c5fd8aa tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:40.003166 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7d725a97-cdac-47c5-b832-a4cb0c5fd8aa tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:40.004319 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7d725a97-cdac-47c5-b832-a4cb0c5fd8aa tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:40.284540 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-7d725a97-cdac-47c5-b832-a4cb0c5fd8aa tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:40.310370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-7d725a97-cdac-47c5-b832-a4cb0c5fd8aa tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1750 microversion: 2.1 time: 0.329498 Jun 07 14:26:40.311013 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 295/561] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:39 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1750 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:41.182069 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-6d4a7832-a808-4af8-846e-c8d19ea4d917 req-faf76690-0137-4691-8a45-e41e585f3040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2740b69b-07ea-4b16-ae3d-3b964bc65edd", "tag": "44ff486f-5bc3-4d1b-9ece-149684ef12b7"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:26:41.197474 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-6d4a7832-a808-4af8-846e-c8d19ea4d917 req-faf76690-0137-4691-8a45-e41e585f3040 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:41.199836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-6d4a7832-a808-4af8-846e-c8d19ea4d917 req-faf76690-0137-4691-8a45-e41e585f3040 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:41.225824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-6d4a7832-a808-4af8-846e-c8d19ea4d917 req-faf76690-0137-4691-8a45-e41e585f3040 service nova] Creating event network-changed:44ff486f-5bc3-4d1b-9ece-149684ef12b7 for instance 2740b69b-07ea-4b16-ae3d-3b964bc65edd on hv-cinder-83608 Jun 07 14:26:41.244391 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-6d4a7832-a808-4af8-846e-c8d19ea4d917 req-faf76690-0137-4691-8a45-e41e585f3040 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192853 Jun 07 14:26:41.244391 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 267/562] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:26:41.252017 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-b721fa20-21f7-4848-8ec7-70b61a4d9755 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:41.253611 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-b721fa20-21f7-4848-8ec7-70b61a4d9755 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:41.270923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b721fa20-21f7-4848-8ec7-70b61a4d9755 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:41.280208 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b721fa20-21f7-4848-8ec7-70b61a4d9755 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:41.289434 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b721fa20-21f7-4848-8ec7-70b61a4d9755 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:41.289894 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b721fa20-21f7-4848-8ec7-70b61a4d9755 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:41.329308 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-55719328-2391-4581-92ca-959147c59e86 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:41.329998 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-55719328-2391-4581-92ca-959147c59e86 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:41.345663 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-b721fa20-21f7-4848-8ec7-70b61a4d9755 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099911 Jun 07 14:26:41.358325 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-55719328-2391-4581-92ca-959147c59e86 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:41.358787 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-55719328-2391-4581-92ca-959147c59e86 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:41.363806 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-55719328-2391-4581-92ca-959147c59e86 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:41.364584 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-55719328-2391-4581-92ca-959147c59e86 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:41.367122 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 296/563] 10.222.0.81 () {58 vars in 1301 bytes} [Tue Jun 7 14:26:41 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 14:26:41.451570 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-f4a63128-e86b-43e6-a89e-3576e4cd1e9f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:41.452558 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-f4a63128-e86b-43e6-a89e-3576e4cd1e9f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:41.460783 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f4a63128-e86b-43e6-a89e-3576e4cd1e9f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:41.462068 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f4a63128-e86b-43e6-a89e-3576e4cd1e9f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:41.463044 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f4a63128-e86b-43e6-a89e-3576e4cd1e9f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:41.463928 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f4a63128-e86b-43e6-a89e-3576e4cd1e9f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:41.504620 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-f4a63128-e86b-43e6-a89e-3576e4cd1e9f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Going to try to terminate instance {{(pid=117565) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:26:41.654702 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-f4a63128-e86b-43e6-a89e-3576e4cd1e9f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 204 len: 0 microversion: 2.1 time: 0.206461 Jun 07 14:26:41.656033 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 297/564] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:26:41 2022] DELETE /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 14:26:41.665006 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-4a77bbcd-7c7a-4a79-8794-4f7718f05c08 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:41.665982 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-4a77bbcd-7c7a-4a79-8794-4f7718f05c08 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:41.673144 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4a77bbcd-7c7a-4a79-8794-4f7718f05c08 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:41.673833 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4a77bbcd-7c7a-4a79-8794-4f7718f05c08 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:41.675839 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4a77bbcd-7c7a-4a79-8794-4f7718f05c08 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:41.676668 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4a77bbcd-7c7a-4a79-8794-4f7718f05c08 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:41.800557 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-55719328-2391-4581-92ca-959147c59e86 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:41.808463 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-55719328-2391-4581-92ca-959147c59e86 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1750 microversion: 2.1 time: 0.483266 Jun 07 14:26:41.809296 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 268/565] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:41 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1750 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:41.875666 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-4a77bbcd-7c7a-4a79-8794-4f7718f05c08 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:41.885100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-4a77bbcd-7c7a-4a79-8794-4f7718f05c08 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1669 microversion: 2.1 time: 0.224753 Jun 07 14:26:41.885838 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 298/566] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:41 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1669 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:26:42.828453 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-59f415c1-0be2-48a2-87c1-1f77f783d378 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:42.829053 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-59f415c1-0be2-48a2-87c1-1f77f783d378 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:42.837450 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-59f415c1-0be2-48a2-87c1-1f77f783d378 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:42.837897 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-59f415c1-0be2-48a2-87c1-1f77f783d378 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:42.838679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-59f415c1-0be2-48a2-87c1-1f77f783d378 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:42.839169 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-59f415c1-0be2-48a2-87c1-1f77f783d378 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:42.905097 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d801d135-7b33-419f-ad73-fb210665dd3a tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:42.906718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-d801d135-7b33-419f-ad73-fb210665dd3a tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:42.913629 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d801d135-7b33-419f-ad73-fb210665dd3a tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:42.914317 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d801d135-7b33-419f-ad73-fb210665dd3a tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:42.915449 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d801d135-7b33-419f-ad73-fb210665dd3a tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:42.915994 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d801d135-7b33-419f-ad73-fb210665dd3a tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:42.922441 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:43.126730 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-59f415c1-0be2-48a2-87c1-1f77f783d378 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:43.136850 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-59f415c1-0be2-48a2-87c1-1f77f783d378 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1755 microversion: 2.1 time: 0.313290 Jun 07 14:26:43.137998 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 269/567] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:42 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1755 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:43.162417 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-d801d135-7b33-419f-ad73-fb210665dd3a tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:43.171728 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-d801d135-7b33-419f-ad73-fb210665dd3a tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1669 microversion: 2.1 time: 0.273066 Jun 07 14:26:43.172376 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 299/568] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:42 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1669 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:26:43.300819 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-3bfe5859-21da-461c-83a8-09acd841c43c req-54b4d9b3-e6aa-41fa-89ba-7cb115ac5af5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2740b69b-07ea-4b16-ae3d-3b964bc65edd", "tag": "44ff486f-5bc3-4d1b-9ece-149684ef12b7"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:26:43.314232 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-3bfe5859-21da-461c-83a8-09acd841c43c req-54b4d9b3-e6aa-41fa-89ba-7cb115ac5af5 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:43.315038 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-3bfe5859-21da-461c-83a8-09acd841c43c req-54b4d9b3-e6aa-41fa-89ba-7cb115ac5af5 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:43.334498 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-3bfe5859-21da-461c-83a8-09acd841c43c req-54b4d9b3-e6aa-41fa-89ba-7cb115ac5af5 service nova] Creating event network-changed:44ff486f-5bc3-4d1b-9ece-149684ef12b7 for instance 2740b69b-07ea-4b16-ae3d-3b964bc65edd on hv-cinder-83608 Jun 07 14:26:43.342996 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-3bfe5859-21da-461c-83a8-09acd841c43c req-54b4d9b3-e6aa-41fa-89ba-7cb115ac5af5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045431 Jun 07 14:26:43.344376 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 270/569] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:26:44.155753 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-63c3c28c-67f5-47e2-9f41-e905ee3e1770 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:44.156379 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-63c3c28c-67f5-47e2-9f41-e905ee3e1770 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:44.162673 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-63c3c28c-67f5-47e2-9f41-e905ee3e1770 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:44.163119 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-63c3c28c-67f5-47e2-9f41-e905ee3e1770 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:44.163948 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-63c3c28c-67f5-47e2-9f41-e905ee3e1770 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:44.164381 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-63c3c28c-67f5-47e2-9f41-e905ee3e1770 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:44.190110 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e9756505-a0bd-4ca1-9405-34e6da459a5f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:44.191451 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e9756505-a0bd-4ca1-9405-34e6da459a5f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:44.197694 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e9756505-a0bd-4ca1-9405-34e6da459a5f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:44.198147 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e9756505-a0bd-4ca1-9405-34e6da459a5f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:44.198979 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e9756505-a0bd-4ca1-9405-34e6da459a5f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:44.199525 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e9756505-a0bd-4ca1-9405-34e6da459a5f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:44.446696 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-63c3c28c-67f5-47e2-9f41-e905ee3e1770 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:44.455280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-63c3c28c-67f5-47e2-9f41-e905ee3e1770 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1755 microversion: 2.1 time: 0.304026 Jun 07 14:26:44.455849 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 300/570] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:44 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1755 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:26:44.466517 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e9756505-a0bd-4ca1-9405-34e6da459a5f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:44.474879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e9756505-a0bd-4ca1-9405-34e6da459a5f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1669 microversion: 2.1 time: 0.289351 Jun 07 14:26:44.478840 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 271/571] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:44 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1669 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:26:45.472722 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-e9236764-0b7d-416b-baa7-09f1ee231ce5 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:45.473386 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-e9236764-0b7d-416b-baa7-09f1ee231ce5 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:45.479493 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e9236764-0b7d-416b-baa7-09f1ee231ce5 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:45.480861 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e9236764-0b7d-416b-baa7-09f1ee231ce5 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:45.481647 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e9236764-0b7d-416b-baa7-09f1ee231ce5 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:45.482085 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e9236764-0b7d-416b-baa7-09f1ee231ce5 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:45.494281 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ce3dad88-13c4-4edb-8558-55e897afb33d tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:45.496557 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ce3dad88-13c4-4edb-8558-55e897afb33d tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:45.505997 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ce3dad88-13c4-4edb-8558-55e897afb33d tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:45.506984 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ce3dad88-13c4-4edb-8558-55e897afb33d tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:45.508001 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ce3dad88-13c4-4edb-8558-55e897afb33d tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:45.509307 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ce3dad88-13c4-4edb-8558-55e897afb33d tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:45.606859 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ce3dad88-13c4-4edb-8558-55e897afb33d tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:45.617770 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ce3dad88-13c4-4edb-8558-55e897afb33d tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 200 len: 1602 microversion: 2.1 time: 0.127771 Jun 07 14:26:45.629419 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 272/572] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:45 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 1602 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:26:45.664370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-e9236764-0b7d-416b-baa7-09f1ee231ce5 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:45.674372 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-e9236764-0b7d-416b-baa7-09f1ee231ce5 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1755 microversion: 2.1 time: 0.205651 Jun 07 14:26:45.675292 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 301/573] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:45 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1755 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:45.721584 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-288eb48e-6878-4a97-b785-2658e68015c7 req-f5a9c2c3-3746-434d-afde-237242729b6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b", "name": "network-vif-deleted", "tag": "3fcce599-f9f4-4a19-a2d1-e0608cd6435f"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:26:45.741504 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-288eb48e-6878-4a97-b785-2658e68015c7 req-f5a9c2c3-3746-434d-afde-237242729b6c service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:45.743562 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-288eb48e-6878-4a97-b785-2658e68015c7 req-f5a9c2c3-3746-434d-afde-237242729b6c service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:45.760009 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-288eb48e-6878-4a97-b785-2658e68015c7 req-f5a9c2c3-3746-434d-afde-237242729b6c service nova] Creating event network-vif-deleted:3fcce599-f9f4-4a19-a2d1-e0608cd6435f for instance ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b on hv-cinder-83608 Jun 07 14:26:45.771869 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-288eb48e-6878-4a97-b785-2658e68015c7 req-f5a9c2c3-3746-434d-afde-237242729b6c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059066 Jun 07 14:26:45.773715 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 273/574] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:26:46.637035 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-8ce747e5-5baf-4f82-89b7-7b1115f393da tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:46.637664 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-8ce747e5-5baf-4f82-89b7-7b1115f393da tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:46.643968 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8ce747e5-5baf-4f82-89b7-7b1115f393da tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:46.644415 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8ce747e5-5baf-4f82-89b7-7b1115f393da tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:46.645183 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8ce747e5-5baf-4f82-89b7-7b1115f393da tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:46.645619 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8ce747e5-5baf-4f82-89b7-7b1115f393da tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:46.660291 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-8ce747e5-5baf-4f82-89b7-7b1115f393da tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] HTTP exception thrown: Instance ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b could not be found. Jun 07 14:26:46.662412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-8ce747e5-5baf-4f82-89b7-7b1115f393da tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Request method failure captured: Jun 07 14:26:46.662412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b HTTP/1.1 Jun 07 14:26:46.662412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:26:46.662412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:26:46.662412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:26:46.662412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:26:46.662412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:26:46.662412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:26:46.662412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:26:46.662412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:26:46.662412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin17zGFzn9BNnNGcNS_NYxDyGpTEsry97j4qlwQiv4PwNtocbq5GO4BjVsaokumbpghiNGjH8wwsTc85YthCbprc52Zopi5qHXPPdKBVJVINiPZnakzMbAv5EbiPLcH7gXBRiiez1aqy8jTOiCXM9joX7OZQXSNdnCpQGI3CabKjhdn0 Jun 07 14:26:46.662412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:26:46.662412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:26:46.662412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:26:46.662412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:26:46.662412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:26:46.662412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:26:46.662412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: 798b460fbb2e4be69df7f5f419844832 Jun 07 14:26:46.662412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-AttachVolumeTestJSON-1474016573 Jun 07 14:26:46.662412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:26:46.662412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:26:46.664135 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/798b460fbb2e4be69df7f5f419844832"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_798b460fbb2e4be69df7f5f419844832", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/798b460fbb2e4be69df7f5f419844832"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/798b460fbb2e4be69df7f5f419844832"}]}] Jun 07 14:26:46.664135 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-AttachVolumeTestJSON-1474016573 Jun 07 14:26:46.664135 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: 798b460fbb2e4be69df7f5f419844832 Jun 07 14:26:46.664135 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1474016573 Jun 07 14:26:46.664135 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-AttachVolumeTestJSON-1474016573-project Jun 07 14:26:46.664135 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:26:46.664135 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:26:46.664135 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: 6592aab6435242dca77b854a74ced4f2 Jun 07 14:26:46.664135 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-AttachVolumeTestJSON-1474016573-project Jun 07 14:26:46.664135 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:26:46.664135 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b could not be found. Jun 07 14:26:46.664135 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': 'ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b'} Jun 07 14:26:46.665107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:26:46.665107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:26:46.665107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:26:46.665107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:26:46.665107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:26:46.665107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:26:46.665107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:26:46.665107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:26:46.665107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:26:46.665107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:26:46.665107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b could not be found. Jun 07 14:26:46.665107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:26:46.665107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:26:46.665107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:26:46.665107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:26:46.665107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:26:46.665107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:26:46.665107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:26:46.665107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:26:46.665107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:26:46.666577 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:26:46.666577 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:26:46.666577 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:26:46.666577 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:26:46.666577 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:26:46.666577 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:26:46.666577 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:26:46.666577 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b could not be found. Jun 07 14:26:46.666577 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:26:46.666577 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:26:46.666577 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:26:46.666577 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:26:46.666577 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:26:46.666577 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:26:46.666577 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:26:46.666577 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:26:46.666577 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b could not be found. Jun 07 14:26:46.666577 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:26:46.668960 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-8ce747e5-5baf-4f82-89b7-7b1115f393da tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Returning 404 to user: Instance ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:26:46.668960 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-8ce747e5-5baf-4f82-89b7-7b1115f393da tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 404 len: 111 microversion: 2.1 time: 0.031984 Jun 07 14:26:46.668960 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 302/575] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:46 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:26:46.675452 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2fe5c965-f50b-4ec1-a9be-3fe9604ef547 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '.version_select at 0x7ff37f431d30>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:46.692445 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-41bad391-d533-4ea7-afef-9f692d28ce96 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:46.693565 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-41bad391-d533-4ea7-afef-9f692d28ce96 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:46.700738 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-41bad391-d533-4ea7-afef-9f692d28ce96 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:46.701334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-41bad391-d533-4ea7-afef-9f692d28ce96 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:46.701803 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2fe5c965-f50b-4ec1-a9be-3fe9604ef547 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-639870198" status: 202 len: 0 microversion: 2.1 time: 0.031808 Jun 07 14:26:46.702308 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-41bad391-d533-4ea7-afef-9f692d28ce96 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:46.705967 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 274/576] 10.222.0.81 () {58 vars in 1217 bytes} [Tue Jun 7 14:26:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-639870198 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:26:46.706099 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-41bad391-d533-4ea7-afef-9f692d28ce96 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:46.960165 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-41bad391-d533-4ea7-afef-9f692d28ce96 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:46.970395 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-41bad391-d533-4ea7-afef-9f692d28ce96 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1755 microversion: 2.1 time: 0.282403 Jun 07 14:26:46.980811 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 303/577] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:46 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1755 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:26:47.564680 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-dcf9b990-36b2-48c8-9160-087ede817d03 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Action: 'create', calling method: .version_select at 0x7ff37f4c54c0>, body: {"keypair": {"name": "tempest-keypair-1516919369", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaVK5f85+4HDEThuozHidSHE01np3ihGDARPnyVkNN/nkcc/JhMN9u/IXB2g2eUYOMI/QkG3va4gOq9NKGCXKcEE49BP1YVtun/lfGXyv2boo+pcDIyh1BP7eAyjKUcUA=="}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:26:47.579048 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-dcf9b990-36b2-48c8-9160-087ede817d03 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Getting quotas for project 798b460fbb2e4be69df7f5f419844832. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:26:47.582932 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-dcf9b990-36b2-48c8-9160-087ede817d03 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Getting quotas for user 6592aab6435242dca77b854a74ced4f2 and project 798b460fbb2e4be69df7f5f419844832. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:26:47.606715 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-dcf9b990-36b2-48c8-9160-087ede817d03 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045934 Jun 07 14:26:47.607340 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 275/578] 10.222.0.81 () {60 vars in 1158 bytes} [Tue Jun 7 14:26:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:26:47.887964 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 14:26:47.888541 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Tue Jun 7 14:26:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 14:26:47.990409 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ae54a4fd-3f83-4fe0-8eab-5807427dd55a tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:47.991840 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ae54a4fd-3f83-4fe0-8eab-5807427dd55a tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:48.003167 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ae54a4fd-3f83-4fe0-8eab-5807427dd55a tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:48.004266 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ae54a4fd-3f83-4fe0-8eab-5807427dd55a tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:48.005279 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ae54a4fd-3f83-4fe0-8eab-5807427dd55a tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:48.005894 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ae54a4fd-3f83-4fe0-8eab-5807427dd55a tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:48.199101 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ae54a4fd-3f83-4fe0-8eab-5807427dd55a tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:48.208100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ae54a4fd-3f83-4fe0-8eab-5807427dd55a tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1755 microversion: 2.1 time: 0.222240 Jun 07 14:26:48.208969 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 304/579] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:47 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1755 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:26:49.029901 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b6b9a56f-e862-488c-8add-580a8845bbf4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2074060837", "imageRef": "2864004b-970a-480b-8453-14794f9ccca2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9379a31-560f-4227-b159-63bce9fe1b34"}], "security_groups": [{"name": "tempest-securitygroup--555558973"}], "key_name": "tempest-keypair-1516919369", "user_data": "}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:26:49.136445 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.network.neutron [None req-b6b9a56f-e862-488c-8add-580a8845bbf4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] validate_networks() for [('c9379a31-560f-4227-b159-63bce9fe1b34', None, None, None, None, None)] {{(pid=117564) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:26:49.225968 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-e0a788d1-98c8-4d12-9534-7436719c1f51 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:49.226697 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-e0a788d1-98c8-4d12-9534-7436719c1f51 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:49.233671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e0a788d1-98c8-4d12-9534-7436719c1f51 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:49.234141 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e0a788d1-98c8-4d12-9534-7436719c1f51 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:49.234946 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e0a788d1-98c8-4d12-9534-7436719c1f51 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:49.235494 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e0a788d1-98c8-4d12-9534-7436719c1f51 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:49.427137 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-e0a788d1-98c8-4d12-9534-7436719c1f51 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:49.435716 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-e0a788d1-98c8-4d12-9534-7436719c1f51 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1755 microversion: 2.1 time: 0.213611 Jun 07 14:26:49.436282 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 305/580] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:49 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1755 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:26:49.609933 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-b6b9a56f-e862-488c-8add-580a8845bbf4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Flavor limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:26:49.610359 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-b6b9a56f-e862-488c-8add-580a8845bbf4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Image limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:26:49.610866 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-b6b9a56f-e862-488c-8add-580a8845bbf4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Flavor pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:26:49.611352 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-b6b9a56f-e862-488c-8add-580a8845bbf4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Image pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:26:49.611770 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-b6b9a56f-e862-488c-8add-580a8845bbf4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:26:49.621116 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b6b9a56f-e862-488c-8add-580a8845bbf4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:49.621564 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b6b9a56f-e862-488c-8add-580a8845bbf4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:49.622354 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b6b9a56f-e862-488c-8add-580a8845bbf4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:49.622792 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b6b9a56f-e862-488c-8add-580a8845bbf4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:49.640366 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-b6b9a56f-e862-488c-8add-580a8845bbf4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Getting quotas for project 798b460fbb2e4be69df7f5f419844832. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:26:49.644447 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-b6b9a56f-e862-488c-8add-580a8845bbf4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Getting quotas for user 6592aab6435242dca77b854a74ced4f2 and project 798b460fbb2e4be69df7f5f419844832. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:26:49.656438 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b6b9a56f-e862-488c-8add-580a8845bbf4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Going to run 1 instances... {{(pid=117564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:26:49.658818 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b6b9a56f-e862-488c-8add-580a8845bbf4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2864004b-970a-480b-8453-14794f9ccca2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:26:49.705194 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b6b9a56f-e862-488c-8add-580a8845bbf4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.680658 Jun 07 14:26:49.705852 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 276/581] 10.222.0.81 () {60 vars in 1146 bytes} [Tue Jun 7 14:26:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:26:49.716781 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-4261b3c1-d89b-4399-9dce-6b5649d320db tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:49.717398 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-4261b3c1-d89b-4399-9dce-6b5649d320db tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:49.771522 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-4261b3c1-d89b-4399-9dce-6b5649d320db tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:49.779152 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-4261b3c1-d89b-4399-9dce-6b5649d320db tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b" status: 200 len: 1238 microversion: 2.1 time: 0.067282 Jun 07 14:26:49.779755 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 306/582] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:49 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:50.454153 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-899bdf8c-9451-4b10-9f6f-a3d514869d1d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:50.454765 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-899bdf8c-9451-4b10-9f6f-a3d514869d1d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:50.463432 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-899bdf8c-9451-4b10-9f6f-a3d514869d1d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:50.464085 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-899bdf8c-9451-4b10-9f6f-a3d514869d1d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:50.465521 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-899bdf8c-9451-4b10-9f6f-a3d514869d1d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:50.465962 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-899bdf8c-9451-4b10-9f6f-a3d514869d1d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:50.609851 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-899bdf8c-9451-4b10-9f6f-a3d514869d1d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:50.618490 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-899bdf8c-9451-4b10-9f6f-a3d514869d1d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1755 microversion: 2.1 time: 0.168867 Jun 07 14:26:50.619071 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 277/583] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:50 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:50.796033 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-00e1cf8e-2d4d-4c01-865c-d69c7fca52ce tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:50.796643 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-00e1cf8e-2d4d-4c01-865c-d69c7fca52ce tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:50.802748 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-00e1cf8e-2d4d-4c01-865c-d69c7fca52ce tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:50.803256 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-00e1cf8e-2d4d-4c01-865c-d69c7fca52ce tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:50.804026 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-00e1cf8e-2d4d-4c01-865c-d69c7fca52ce tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:50.804462 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-00e1cf8e-2d4d-4c01-865c-d69c7fca52ce tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:50.873731 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-00e1cf8e-2d4d-4c01-865c-d69c7fca52ce tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:50.882355 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-00e1cf8e-2d4d-4c01-865c-d69c7fca52ce tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b" status: 200 len: 1290 microversion: 2.1 time: 0.089987 Jun 07 14:26:50.882921 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 307/584] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:50 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b => generated 1290 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:51.639373 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8fe9a865-b3f7-4b86-9ae9-f17fe71992e7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:51.640165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8fe9a865-b3f7-4b86-9ae9-f17fe71992e7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:51.647844 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8fe9a865-b3f7-4b86-9ae9-f17fe71992e7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:51.654098 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8fe9a865-b3f7-4b86-9ae9-f17fe71992e7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:51.655191 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8fe9a865-b3f7-4b86-9ae9-f17fe71992e7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:51.655813 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8fe9a865-b3f7-4b86-9ae9-f17fe71992e7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:51.680771 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:51.849188 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8fe9a865-b3f7-4b86-9ae9-f17fe71992e7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:51.859726 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8fe9a865-b3f7-4b86-9ae9-f17fe71992e7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1755 microversion: 2.1 time: 0.224306 Jun 07 14:26:51.869895 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 278/585] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:51 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1755 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:51.904271 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-453bedcd-b1de-4bd2-99b1-aa40498d42e5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:51.905094 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-453bedcd-b1de-4bd2-99b1-aa40498d42e5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:51.912413 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-453bedcd-b1de-4bd2-99b1-aa40498d42e5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:51.912995 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-453bedcd-b1de-4bd2-99b1-aa40498d42e5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:51.914471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-453bedcd-b1de-4bd2-99b1-aa40498d42e5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:51.914988 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-453bedcd-b1de-4bd2-99b1-aa40498d42e5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:52.060846 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-453bedcd-b1de-4bd2-99b1-aa40498d42e5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:52.068244 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-453bedcd-b1de-4bd2-99b1-aa40498d42e5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b" status: 200 len: 1363 microversion: 2.1 time: 0.171674 Jun 07 14:26:52.068802 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 308/586] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:51 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:52.375750 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-6639efda-0bcf-409b-b846-e5ac8a760ea6 req-5690e61d-49dd-41fe-b276-0169f4b16727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8660c0c-0d13-43ac-8023-08fa4f47a54b", "tag": "cdcc0f1d-c9a0-45ba-bcf6-633cbdd7c4c0"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:26:52.386523 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-6639efda-0bcf-409b-b846-e5ac8a760ea6 req-5690e61d-49dd-41fe-b276-0169f4b16727 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:52.386956 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-6639efda-0bcf-409b-b846-e5ac8a760ea6 req-5690e61d-49dd-41fe-b276-0169f4b16727 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:52.399757 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-6639efda-0bcf-409b-b846-e5ac8a760ea6 req-5690e61d-49dd-41fe-b276-0169f4b16727 service nova] Creating event network-changed:cdcc0f1d-c9a0-45ba-bcf6-633cbdd7c4c0 for instance e8660c0c-0d13-43ac-8023-08fa4f47a54b on hv-cinder-83608 Jun 07 14:26:52.410414 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-6639efda-0bcf-409b-b846-e5ac8a760ea6 req-5690e61d-49dd-41fe-b276-0169f4b16727 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039320 Jun 07 14:26:52.411153 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 279/587] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:26:52.876962 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-babe8982-8b55-47af-b057-ae1e297c65b7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:52.877576 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-babe8982-8b55-47af-b057-ae1e297c65b7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:52.883656 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-babe8982-8b55-47af-b057-ae1e297c65b7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:52.884105 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-babe8982-8b55-47af-b057-ae1e297c65b7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:52.884892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-babe8982-8b55-47af-b057-ae1e297c65b7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:52.885328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-babe8982-8b55-47af-b057-ae1e297c65b7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:53.033019 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-babe8982-8b55-47af-b057-ae1e297c65b7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:53.040831 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-babe8982-8b55-47af-b057-ae1e297c65b7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1755 microversion: 2.1 time: 0.167727 Jun 07 14:26:53.041389 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 309/588] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:52 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:26:53.086779 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c4f4ee34-94b4-4fac-bbbb-668cc15cc935 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:53.087511 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c4f4ee34-94b4-4fac-bbbb-668cc15cc935 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:53.094719 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c4f4ee34-94b4-4fac-bbbb-668cc15cc935 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:53.095168 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c4f4ee34-94b4-4fac-bbbb-668cc15cc935 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:53.095958 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c4f4ee34-94b4-4fac-bbbb-668cc15cc935 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:53.096392 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c4f4ee34-94b4-4fac-bbbb-668cc15cc935 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:53.224569 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c4f4ee34-94b4-4fac-bbbb-668cc15cc935 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:53.231993 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c4f4ee34-94b4-4fac-bbbb-668cc15cc935 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b" status: 200 len: 1363 microversion: 2.1 time: 0.150279 Jun 07 14:26:53.232564 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 280/589] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:53 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:54.058372 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-95ae8aa3-6444-4400-8872-9f59a3281696 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:54.058979 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-95ae8aa3-6444-4400-8872-9f59a3281696 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:54.065087 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-95ae8aa3-6444-4400-8872-9f59a3281696 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:54.065528 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-95ae8aa3-6444-4400-8872-9f59a3281696 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:54.066278 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-95ae8aa3-6444-4400-8872-9f59a3281696 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:54.066708 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-95ae8aa3-6444-4400-8872-9f59a3281696 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:54.213414 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-95ae8aa3-6444-4400-8872-9f59a3281696 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:54.222197 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-95ae8aa3-6444-4400-8872-9f59a3281696 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1755 microversion: 2.1 time: 0.168231 Jun 07 14:26:54.222773 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 310/590] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:54 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:54.249661 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-777c4a67-81da-4bef-862c-dc2f4acce50c tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:54.250404 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-777c4a67-81da-4bef-862c-dc2f4acce50c tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:54.257015 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-777c4a67-81da-4bef-862c-dc2f4acce50c tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:54.257527 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-777c4a67-81da-4bef-862c-dc2f4acce50c tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:54.258291 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-777c4a67-81da-4bef-862c-dc2f4acce50c tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:54.258732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-777c4a67-81da-4bef-862c-dc2f4acce50c tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:54.386822 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-777c4a67-81da-4bef-862c-dc2f4acce50c tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:54.394380 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-777c4a67-81da-4bef-862c-dc2f4acce50c tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b" status: 200 len: 1363 microversion: 2.1 time: 0.149445 Jun 07 14:26:54.394959 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 281/591] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:54 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:55.239472 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-a8ffd5b6-484e-4a71-8be0-3370679e99f8 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:55.240079 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-a8ffd5b6-484e-4a71-8be0-3370679e99f8 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:55.246817 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a8ffd5b6-484e-4a71-8be0-3370679e99f8 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:55.247280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a8ffd5b6-484e-4a71-8be0-3370679e99f8 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:55.248034 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a8ffd5b6-484e-4a71-8be0-3370679e99f8 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:55.248465 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a8ffd5b6-484e-4a71-8be0-3370679e99f8 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:55.392491 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-a8ffd5b6-484e-4a71-8be0-3370679e99f8 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:55.400396 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-a8ffd5b6-484e-4a71-8be0-3370679e99f8 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1755 microversion: 2.1 time: 0.164808 Jun 07 14:26:55.400952 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 311/592] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:55 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:55.411296 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-743ce721-6a38-48ac-a532-d59a6b2ffbf4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:55.411908 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-743ce721-6a38-48ac-a532-d59a6b2ffbf4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:55.418535 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-743ce721-6a38-48ac-a532-d59a6b2ffbf4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:55.418918 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-743ce721-6a38-48ac-a532-d59a6b2ffbf4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:55.419698 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-743ce721-6a38-48ac-a532-d59a6b2ffbf4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:55.420132 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-743ce721-6a38-48ac-a532-d59a6b2ffbf4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:55.548566 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-743ce721-6a38-48ac-a532-d59a6b2ffbf4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:55.555828 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-743ce721-6a38-48ac-a532-d59a6b2ffbf4 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b" status: 200 len: 1363 microversion: 2.1 time: 0.148406 Jun 07 14:26:55.556388 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 282/593] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:55 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:56.418436 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-b25bcb5d-7f7e-42a0-9992-007aa4a0c6ff tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:56.419060 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-b25bcb5d-7f7e-42a0-9992-007aa4a0c6ff tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:56.425729 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b25bcb5d-7f7e-42a0-9992-007aa4a0c6ff tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:56.426179 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b25bcb5d-7f7e-42a0-9992-007aa4a0c6ff tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:56.426931 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b25bcb5d-7f7e-42a0-9992-007aa4a0c6ff tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:56.427405 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b25bcb5d-7f7e-42a0-9992-007aa4a0c6ff tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:56.566628 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-b25bcb5d-7f7e-42a0-9992-007aa4a0c6ff tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:56.573355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ad927820-6e7d-43d9-add7-8d3da782aad9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:56.574095 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ad927820-6e7d-43d9-add7-8d3da782aad9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:56.574820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-b25bcb5d-7f7e-42a0-9992-007aa4a0c6ff tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1755 microversion: 2.1 time: 0.160838 Jun 07 14:26:56.575436 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 312/594] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:56 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:56.580906 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ad927820-6e7d-43d9-add7-8d3da782aad9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:56.581349 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ad927820-6e7d-43d9-add7-8d3da782aad9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:56.582107 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ad927820-6e7d-43d9-add7-8d3da782aad9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:56.582541 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ad927820-6e7d-43d9-add7-8d3da782aad9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:56.713639 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ad927820-6e7d-43d9-add7-8d3da782aad9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:56.721471 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ad927820-6e7d-43d9-add7-8d3da782aad9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b" status: 200 len: 1363 microversion: 2.1 time: 0.152128 Jun 07 14:26:56.722041 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 283/595] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:56 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:26:57.591944 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-4bbe73f0-ce4a-4958-bfc8-794c312f61bb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:57.592604 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-4bbe73f0-ce4a-4958-bfc8-794c312f61bb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:57.598941 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4bbe73f0-ce4a-4958-bfc8-794c312f61bb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:57.599431 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4bbe73f0-ce4a-4958-bfc8-794c312f61bb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:57.600193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4bbe73f0-ce4a-4958-bfc8-794c312f61bb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:57.600630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4bbe73f0-ce4a-4958-bfc8-794c312f61bb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:57.739928 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-4bbe73f0-ce4a-4958-bfc8-794c312f61bb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:57.740182 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7dc3c2a2-72b7-4ff3-bbba-e4d621883639 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:57.740851 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7dc3c2a2-72b7-4ff3-bbba-e4d621883639 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:57.748106 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7dc3c2a2-72b7-4ff3-bbba-e4d621883639 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:57.750086 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-4bbe73f0-ce4a-4958-bfc8-794c312f61bb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1755 microversion: 2.1 time: 0.160779 Jun 07 14:26:57.750213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7dc3c2a2-72b7-4ff3-bbba-e4d621883639 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:57.750338 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 313/596] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:57 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:57.768523 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7dc3c2a2-72b7-4ff3-bbba-e4d621883639 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:57.768991 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7dc3c2a2-72b7-4ff3-bbba-e4d621883639 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:57.892193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-112c8c6c-4350-40dd-a9ee-902552e419be req-328df3c3-b470-4bd5-b268-ffef3fa7eecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8660c0c-0d13-43ac-8023-08fa4f47a54b", "name": "network-vif-plugged", "status": "completed", "tag": "cdcc0f1d-c9a0-45ba-bcf6-633cbdd7c4c0"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:26:57.902469 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-112c8c6c-4350-40dd-a9ee-902552e419be req-328df3c3-b470-4bd5-b268-ffef3fa7eecd service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:57.902896 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-112c8c6c-4350-40dd-a9ee-902552e419be req-328df3c3-b470-4bd5-b268-ffef3fa7eecd service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:57.916562 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-112c8c6c-4350-40dd-a9ee-902552e419be req-328df3c3-b470-4bd5-b268-ffef3fa7eecd service nova] Creating event network-vif-plugged:cdcc0f1d-c9a0-45ba-bcf6-633cbdd7c4c0 for instance e8660c0c-0d13-43ac-8023-08fa4f47a54b on hv-cinder-83608 Jun 07 14:26:57.920256 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-7dc3c2a2-72b7-4ff3-bbba-e4d621883639 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:57.923265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-112c8c6c-4350-40dd-a9ee-902552e419be req-328df3c3-b470-4bd5-b268-ffef3fa7eecd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035267 Jun 07 14:26:57.924818 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 314/597] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:26:57.928424 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7dc3c2a2-72b7-4ff3-bbba-e4d621883639 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b" status: 200 len: 1363 microversion: 2.1 time: 0.193129 Jun 07 14:26:57.929484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 284/598] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:57 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:26:57.930553 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-f37dede7-cc99-4b94-870e-dc5d80a022b0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1853262728", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-234910173", "security_groups": [{"name": "tempest-secgroup-smoke-1262891354"}], "block_device_mapping_v2": [{"uuid": "a19f11df-e181-473c-a5b7-bd25be733238", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2c006233-0519-428c-b750-6c5e4d46a20e"}]}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:26:58.053008 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.network.neutron [None req-f37dede7-cc99-4b94-870e-dc5d80a022b0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] validate_networks() for [('2c006233-0519-428c-b750-6c5e4d46a20e', None, None, None, None, None)] {{(pid=117565) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:26:58.457227 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-f37dede7-cc99-4b94-870e-dc5d80a022b0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Flavor limits 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:26:58.457648 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-f37dede7-cc99-4b94-870e-dc5d80a022b0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Image limits 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:26:58.458120 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-f37dede7-cc99-4b94-870e-dc5d80a022b0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Flavor pref 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:26:58.458549 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-f37dede7-cc99-4b94-870e-dc5d80a022b0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Image pref 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:26:58.458953 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-f37dede7-cc99-4b94-870e-dc5d80a022b0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:26:58.468856 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f37dede7-cc99-4b94-870e-dc5d80a022b0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:58.469293 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f37dede7-cc99-4b94-870e-dc5d80a022b0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:58.470076 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f37dede7-cc99-4b94-870e-dc5d80a022b0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:58.470504 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f37dede7-cc99-4b94-870e-dc5d80a022b0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:58.487385 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-f37dede7-cc99-4b94-870e-dc5d80a022b0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Getting quotas for project 6ee52855d08e467f9d2f02685d7bf541. Resources: {'ram', 'cores', 'instances'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:26:58.491250 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-f37dede7-cc99-4b94-870e-dc5d80a022b0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Getting quotas for user d0b828a3dca14f2283a16894364d6eef and project 6ee52855d08e467f9d2f02685d7bf541. Resources: {'ram', 'cores', 'instances'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:26:58.547376 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-f37dede7-cc99-4b94-870e-dc5d80a022b0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Going to run 1 instances... {{(pid=117565) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:26:58.549502 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-f37dede7-cc99-4b94-870e-dc5d80a022b0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a19f11df-e181-473c-a5b7-bd25be733238',volume_size=None,volume_type=None)] {{(pid=117565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:26:58.675090 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-f37dede7-cc99-4b94-870e-dc5d80a022b0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.749079 Jun 07 14:26:58.676084 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 315/599] 10.222.0.81 () {60 vars in 1146 bytes} [Tue Jun 7 14:26:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:26:58.686034 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-869b1df8-622a-40d2-b30f-7829aea3481c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:58.686725 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-869b1df8-622a-40d2-b30f-7829aea3481c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:58.742007 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-869b1df8-622a-40d2-b30f-7829aea3481c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:58.749439 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-869b1df8-622a-40d2-b30f-7829aea3481c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141" status: 200 len: 1094 microversion: 2.1 time: 0.067595 Jun 07 14:26:58.750263 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 285/600] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:58 2022] GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:58.767751 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3763247d-87b5-4c1a-9b68-787db00aa9e3 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:58.768443 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-3763247d-87b5-4c1a-9b68-787db00aa9e3 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:58.775665 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3763247d-87b5-4c1a-9b68-787db00aa9e3 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:58.776163 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3763247d-87b5-4c1a-9b68-787db00aa9e3 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:58.777516 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3763247d-87b5-4c1a-9b68-787db00aa9e3 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:58.777952 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3763247d-87b5-4c1a-9b68-787db00aa9e3 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:58.926760 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-3763247d-87b5-4c1a-9b68-787db00aa9e3 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:58.935615 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-3763247d-87b5-4c1a-9b68-787db00aa9e3 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1755 microversion: 2.1 time: 0.172845 Jun 07 14:26:58.936285 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 316/601] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:58 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:58.946069 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-70d9ad9d-517e-49cd-9bb7-67200d43b6fb tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:58.946680 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-70d9ad9d-517e-49cd-9bb7-67200d43b6fb tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:58.953543 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-70d9ad9d-517e-49cd-9bb7-67200d43b6fb tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:58.954146 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-70d9ad9d-517e-49cd-9bb7-67200d43b6fb tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:58.955005 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-70d9ad9d-517e-49cd-9bb7-67200d43b6fb tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:58.955503 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-70d9ad9d-517e-49cd-9bb7-67200d43b6fb tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:59.304369 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-70d9ad9d-517e-49cd-9bb7-67200d43b6fb tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:59.312470 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-70d9ad9d-517e-49cd-9bb7-67200d43b6fb tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b" status: 200 len: 1363 microversion: 2.1 time: 0.370272 Jun 07 14:26:59.313041 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 286/602] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:58 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b => generated 1363 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:59.421703 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 14:26:59.421905 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Tue Jun 7 14:26:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 14:26:59.765595 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-6db0f04b-e26d-432a-8140-075d37d55093 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:59.766230 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-6db0f04b-e26d-432a-8140-075d37d55093 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:59.772273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6db0f04b-e26d-432a-8140-075d37d55093 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:59.772723 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6db0f04b-e26d-432a-8140-075d37d55093 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:59.773485 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6db0f04b-e26d-432a-8140-075d37d55093 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:59.773921 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6db0f04b-e26d-432a-8140-075d37d55093 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:59.834475 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-6db0f04b-e26d-432a-8140-075d37d55093 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:26:59.842634 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-6db0f04b-e26d-432a-8140-075d37d55093 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141" status: 200 len: 1192 microversion: 2.1 time: 0.080913 Jun 07 14:26:59.843459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 317/603] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:59 2022] GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 => generated 1192 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:26:59.952965 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5bde233e-c978-44d8-bc42-22b5de8824a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:26:59.953576 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-5bde233e-c978-44d8-bc42-22b5de8824a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:26:59.955549 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:59.961267 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5bde233e-c978-44d8-bc42-22b5de8824a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:59.961706 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5bde233e-c978-44d8-bc42-22b5de8824a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:26:59.962462 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5bde233e-c978-44d8-bc42-22b5de8824a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:26:59.962892 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5bde233e-c978-44d8-bc42-22b5de8824a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:00.112903 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5bde233e-c978-44d8-bc42-22b5de8824a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:00.121132 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-5bde233e-c978-44d8-bc42-22b5de8824a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1755 microversion: 2.1 time: 0.172161 Jun 07 14:27:00.121720 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 287/604] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:26:59 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:00.329893 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-5c93e197-9325-4f34-9478-bef95889b5e3 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:00.330423 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-5c93e197-9325-4f34-9478-bef95889b5e3 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:00.336527 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5c93e197-9325-4f34-9478-bef95889b5e3 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:00.337004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5c93e197-9325-4f34-9478-bef95889b5e3 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:00.337736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5c93e197-9325-4f34-9478-bef95889b5e3 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:00.338168 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-5c93e197-9325-4f34-9478-bef95889b5e3 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:00.465337 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-5c93e197-9325-4f34-9478-bef95889b5e3 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:00.468992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=100 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:00.474086 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-5c93e197-9325-4f34-9478-bef95889b5e3 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b" status: 200 len: 1550 microversion: 2.1 time: 0.147884 Jun 07 14:27:00.474634 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 318/605] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:00 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b => generated 1550 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:00.489814 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8418d296-44e8-4fe5-9e7c-86e29b864a14 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:00.490306 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8418d296-44e8-4fe5-9e7c-86e29b864a14 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:00.496830 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8418d296-44e8-4fe5-9e7c-86e29b864a14 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:00.497274 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8418d296-44e8-4fe5-9e7c-86e29b864a14 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:00.498030 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8418d296-44e8-4fe5-9e7c-86e29b864a14 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:00.498463 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8418d296-44e8-4fe5-9e7c-86e29b864a14 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:00.574129 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8418d296-44e8-4fe5-9e7c-86e29b864a14 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087532 Jun 07 14:27:00.574754 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 288/606] 10.222.0.81 () {58 vars in 1274 bytes} [Tue Jun 7 14:27:00 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:27:00.860290 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-62f4fa27-8aeb-4f4c-9573-98c82fbbea62 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:00.860881 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-62f4fa27-8aeb-4f4c-9573-98c82fbbea62 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:00.866985 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-62f4fa27-8aeb-4f4c-9573-98c82fbbea62 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:00.867484 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-62f4fa27-8aeb-4f4c-9573-98c82fbbea62 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:00.868253 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-62f4fa27-8aeb-4f4c-9573-98c82fbbea62 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:00.868693 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-62f4fa27-8aeb-4f4c-9573-98c82fbbea62 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:00.988821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-62f4fa27-8aeb-4f4c-9573-98c82fbbea62 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:00.998212 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-62f4fa27-8aeb-4f4c-9573-98c82fbbea62 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141" status: 200 len: 1200 microversion: 2.1 time: 0.141764 Jun 07 14:27:00.998794 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 319/607] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:00 2022] GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 => generated 1200 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:01.138705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3b88bf85-912e-4774-a542-b7a8fcb9329e tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:01.139901 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3b88bf85-912e-4774-a542-b7a8fcb9329e tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:01.146174 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3b88bf85-912e-4774-a542-b7a8fcb9329e tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:01.146855 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3b88bf85-912e-4774-a542-b7a8fcb9329e tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:01.147839 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3b88bf85-912e-4774-a542-b7a8fcb9329e tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:01.148427 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3b88bf85-912e-4774-a542-b7a8fcb9329e tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:01.434516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3b88bf85-912e-4774-a542-b7a8fcb9329e tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:01.444426 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3b88bf85-912e-4774-a542-b7a8fcb9329e tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1758 microversion: 2.1 time: 0.310503 Jun 07 14:27:01.445045 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 289/608] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:01 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1758 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:01.949082 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-45093da7-33b9-4117-beca-213e76df1abc req-7f665e2e-38cd-4623-af24-81d017f5c053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8660c0c-0d13-43ac-8023-08fa4f47a54b", "tag": "cdcc0f1d-c9a0-45ba-bcf6-633cbdd7c4c0"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:27:01.958241 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-45093da7-33b9-4117-beca-213e76df1abc req-7f665e2e-38cd-4623-af24-81d017f5c053 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:01.958684 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-45093da7-33b9-4117-beca-213e76df1abc req-7f665e2e-38cd-4623-af24-81d017f5c053 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:01.972001 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-45093da7-33b9-4117-beca-213e76df1abc req-7f665e2e-38cd-4623-af24-81d017f5c053 service nova] Creating event network-changed:cdcc0f1d-c9a0-45ba-bcf6-633cbdd7c4c0 for instance e8660c0c-0d13-43ac-8023-08fa4f47a54b on hv-cinder-83608 Jun 07 14:27:01.977123 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-45093da7-33b9-4117-beca-213e76df1abc req-7f665e2e-38cd-4623-af24-81d017f5c053 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107835 Jun 07 14:27:01.977720 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 320/609] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:27:02.031149 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1199a478-332f-473a-8049-c3f171e925b5 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:02.032088 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1199a478-332f-473a-8049-c3f171e925b5 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:02.043314 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1199a478-332f-473a-8049-c3f171e925b5 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:02.044072 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1199a478-332f-473a-8049-c3f171e925b5 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:02.046054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1199a478-332f-473a-8049-c3f171e925b5 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:02.046598 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1199a478-332f-473a-8049-c3f171e925b5 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:02.497853 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1199a478-332f-473a-8049-c3f171e925b5 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:02.516582 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1199a478-332f-473a-8049-c3f171e925b5 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141" status: 200 len: 1266 microversion: 2.1 time: 0.504014 Jun 07 14:27:02.519878 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 290/610] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:02 2022] GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 => generated 1266 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:02.558395 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-f3138e8e-4769-4bd4-888c-f3002900ef5b req-d8538691-4d66-4599-9a2f-4193fc778dcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99bfe151-4396-4c86-9fb5-f26989972141", "tag": "cf62c8e3-d8c3-4512-a430-f4144559869d"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:27:02.587398 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-f3138e8e-4769-4bd4-888c-f3002900ef5b req-d8538691-4d66-4599-9a2f-4193fc778dcc service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:02.589184 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-f3138e8e-4769-4bd4-888c-f3002900ef5b req-d8538691-4d66-4599-9a2f-4193fc778dcc service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:02.617292 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-f3138e8e-4769-4bd4-888c-f3002900ef5b req-d8538691-4d66-4599-9a2f-4193fc778dcc service nova] Creating event network-changed:cf62c8e3-d8c3-4512-a430-f4144559869d for instance 99bfe151-4396-4c86-9fb5-f26989972141 on hv-cinder-83608 Jun 07 14:27:02.626838 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-f3138e8e-4769-4bd4-888c-f3002900ef5b req-d8538691-4d66-4599-9a2f-4193fc778dcc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073090 Jun 07 14:27:02.628089 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 321/611] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:27:03.536409 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b5957d47-39c1-4a93-a427-1e88c2f10a45 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:03.537015 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b5957d47-39c1-4a93-a427-1e88c2f10a45 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:03.545102 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b5957d47-39c1-4a93-a427-1e88c2f10a45 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:03.545548 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b5957d47-39c1-4a93-a427-1e88c2f10a45 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:03.546321 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b5957d47-39c1-4a93-a427-1e88c2f10a45 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:03.546754 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b5957d47-39c1-4a93-a427-1e88c2f10a45 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:03.683259 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b5957d47-39c1-4a93-a427-1e88c2f10a45 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:03.691552 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b5957d47-39c1-4a93-a427-1e88c2f10a45 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141" status: 200 len: 1266 microversion: 2.1 time: 0.158892 Jun 07 14:27:03.692328 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 291/612] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:03 2022] GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:04.539172 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-48193df0-8137-4753-9516-8b1a6896d9e0 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:27:04.539815 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-48193df0-8137-4753-9516-8b1a6896d9e0 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:04.547518 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-48193df0-8137-4753-9516-8b1a6896d9e0 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:04.547974 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-48193df0-8137-4753-9516-8b1a6896d9e0 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:04.548741 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-48193df0-8137-4753-9516-8b1a6896d9e0 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:04.549181 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-48193df0-8137-4753-9516-8b1a6896d9e0 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:04.571128 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.objects.instance [None req-48193df0-8137-4753-9516-8b1a6896d9e0 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lazy-loading 'flavor' on Instance uuid e2714c53-3b93-4d50-9812-e5f0a324b286 {{(pid=117565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:27:04.643329 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-48193df0-8137-4753-9516-8b1a6896d9e0 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "POST /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286/action" status: 202 len: 0 microversion: 2.1 time: 0.108283 Jun 07 14:27:04.643971 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 322/613] 10.222.0.81 () {60 vars in 1277 bytes} [Tue Jun 7 14:27:04 2022] POST /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:27:04.652232 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3eef9d43-94bb-4c93-b586-75ca5ac41b7c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:04.652854 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3eef9d43-94bb-4c93-b586-75ca5ac41b7c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:04.659465 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3eef9d43-94bb-4c93-b586-75ca5ac41b7c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:04.659858 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3eef9d43-94bb-4c93-b586-75ca5ac41b7c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:04.660659 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3eef9d43-94bb-4c93-b586-75ca5ac41b7c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:04.661097 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3eef9d43-94bb-4c93-b586-75ca5ac41b7c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:04.709294 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-c6647366-299e-4f5e-9ac1-e7b56d0bdaca tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:04.710115 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-c6647366-299e-4f5e-9ac1-e7b56d0bdaca tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:04.712156 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:04.719453 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c6647366-299e-4f5e-9ac1-e7b56d0bdaca tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:04.719989 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c6647366-299e-4f5e-9ac1-e7b56d0bdaca tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:04.720767 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c6647366-299e-4f5e-9ac1-e7b56d0bdaca tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:04.721202 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c6647366-299e-4f5e-9ac1-e7b56d0bdaca tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:04.854223 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3eef9d43-94bb-4c93-b586-75ca5ac41b7c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:04.861766 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3eef9d43-94bb-4c93-b586-75ca5ac41b7c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1569 microversion: 2.1 time: 0.213456 Jun 07 14:27:04.862332 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 292/614] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:04 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:04.883314 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-c6647366-299e-4f5e-9ac1-e7b56d0bdaca tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:04.891495 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-c6647366-299e-4f5e-9ac1-e7b56d0bdaca tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141" status: 200 len: 1266 microversion: 2.1 time: 0.186501 Jun 07 14:27:04.892063 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 323/615] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:04 2022] GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:27:05.879365 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a19e020e-3ab3-48b1-8f37-e2637ea02d09 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:05.879968 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a19e020e-3ab3-48b1-8f37-e2637ea02d09 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:05.886718 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a19e020e-3ab3-48b1-8f37-e2637ea02d09 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:05.887158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a19e020e-3ab3-48b1-8f37-e2637ea02d09 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:05.887941 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a19e020e-3ab3-48b1-8f37-e2637ea02d09 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:05.888368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a19e020e-3ab3-48b1-8f37-e2637ea02d09 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:05.907931 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-c9a62f2d-20f3-4144-bfda-967aacebade0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:05.908535 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-c9a62f2d-20f3-4144-bfda-967aacebade0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:05.914538 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c9a62f2d-20f3-4144-bfda-967aacebade0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:05.914990 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c9a62f2d-20f3-4144-bfda-967aacebade0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:05.915787 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c9a62f2d-20f3-4144-bfda-967aacebade0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:05.916232 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c9a62f2d-20f3-4144-bfda-967aacebade0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:06.083039 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a19e020e-3ab3-48b1-8f37-e2637ea02d09 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:06.090607 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a19e020e-3ab3-48b1-8f37-e2637ea02d09 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1569 microversion: 2.1 time: 0.215110 Jun 07 14:27:06.091189 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 293/616] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:05 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1569 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:06.101838 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-c9a62f2d-20f3-4144-bfda-967aacebade0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:06.109931 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-c9a62f2d-20f3-4144-bfda-967aacebade0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141" status: 200 len: 1266 microversion: 2.1 time: 0.205791 Jun 07 14:27:06.110493 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 324/617] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:05 2022] GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:27:07.108423 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-cf7efd71-9f96-478f-9a9f-3c722445390c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:07.109030 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-cf7efd71-9f96-478f-9a9f-3c722445390c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:07.111318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:07.116671 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cf7efd71-9f96-478f-9a9f-3c722445390c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:07.117114 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cf7efd71-9f96-478f-9a9f-3c722445390c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:07.117866 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cf7efd71-9f96-478f-9a9f-3c722445390c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:07.118298 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cf7efd71-9f96-478f-9a9f-3c722445390c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:07.125940 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-49bb6cef-f4ca-4dc5-915f-80c95d99a73b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:07.126549 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-49bb6cef-f4ca-4dc5-915f-80c95d99a73b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:07.132668 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-49bb6cef-f4ca-4dc5-915f-80c95d99a73b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:07.133117 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-49bb6cef-f4ca-4dc5-915f-80c95d99a73b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:07.133880 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-49bb6cef-f4ca-4dc5-915f-80c95d99a73b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:07.134314 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-49bb6cef-f4ca-4dc5-915f-80c95d99a73b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:07.316526 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-cf7efd71-9f96-478f-9a9f-3c722445390c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:07.325045 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-cf7efd71-9f96-478f-9a9f-3c722445390c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1569 microversion: 2.1 time: 0.220780 Jun 07 14:27:07.325705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 294/618] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:07 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:07.329634 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-49bb6cef-f4ca-4dc5-915f-80c95d99a73b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:07.337156 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-49bb6cef-f4ca-4dc5-915f-80c95d99a73b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141" status: 200 len: 1266 microversion: 2.1 time: 0.215168 Jun 07 14:27:07.337709 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 325/619] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:07 2022] GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:27:08.342654 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-22919a35-30b9-4fdb-8e6b-4b5f07648bb6 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:08.344136 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-22919a35-30b9-4fdb-8e6b-4b5f07648bb6 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:08.350634 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-22919a35-30b9-4fdb-8e6b-4b5f07648bb6 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:08.351083 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-22919a35-30b9-4fdb-8e6b-4b5f07648bb6 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:08.351881 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-22919a35-30b9-4fdb-8e6b-4b5f07648bb6 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:08.352311 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-22919a35-30b9-4fdb-8e6b-4b5f07648bb6 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:08.353982 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-241a2789-db3e-4a65-8fa0-f5b7c85a3e88 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:08.355308 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-241a2789-db3e-4a65-8fa0-f5b7c85a3e88 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:08.361532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-241a2789-db3e-4a65-8fa0-f5b7c85a3e88 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:08.361987 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-241a2789-db3e-4a65-8fa0-f5b7c85a3e88 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:08.362754 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-241a2789-db3e-4a65-8fa0-f5b7c85a3e88 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:08.363352 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-241a2789-db3e-4a65-8fa0-f5b7c85a3e88 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:08.477363 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=2 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:08.498467 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=8 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:08.551731 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-22919a35-30b9-4fdb-8e6b-4b5f07648bb6 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:08.556629 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-241a2789-db3e-4a65-8fa0-f5b7c85a3e88 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:08.559543 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-22919a35-30b9-4fdb-8e6b-4b5f07648bb6 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1569 microversion: 2.1 time: 0.221215 Jun 07 14:27:08.560126 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 295/620] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:08 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:08.565165 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-241a2789-db3e-4a65-8fa0-f5b7c85a3e88 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141" status: 200 len: 1266 microversion: 2.1 time: 0.215238 Jun 07 14:27:08.565745 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 326/621] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:08 2022] GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:27:09.577008 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-946a8b9b-a180-448e-b14b-9de40dd2d0c3 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:09.577639 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-946a8b9b-a180-448e-b14b-9de40dd2d0c3 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:09.579588 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=16 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:09.582165 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-32d2fcaf-7f39-4070-a7e9-bdb6f0a0f983 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:09.582773 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-32d2fcaf-7f39-4070-a7e9-bdb6f0a0f983 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:09.585383 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-946a8b9b-a180-448e-b14b-9de40dd2d0c3 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:09.585835 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-946a8b9b-a180-448e-b14b-9de40dd2d0c3 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:09.586598 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-946a8b9b-a180-448e-b14b-9de40dd2d0c3 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:09.587031 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-946a8b9b-a180-448e-b14b-9de40dd2d0c3 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:09.589288 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-32d2fcaf-7f39-4070-a7e9-bdb6f0a0f983 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:09.589816 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-32d2fcaf-7f39-4070-a7e9-bdb6f0a0f983 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:09.590575 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-32d2fcaf-7f39-4070-a7e9-bdb6f0a0f983 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:09.591002 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-32d2fcaf-7f39-4070-a7e9-bdb6f0a0f983 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:09.788147 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-946a8b9b-a180-448e-b14b-9de40dd2d0c3 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:09.795738 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-946a8b9b-a180-448e-b14b-9de40dd2d0c3 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1569 microversion: 2.1 time: 0.222930 Jun 07 14:27:09.796532 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 296/622] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:09 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1569 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:09.801725 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-32d2fcaf-7f39-4070-a7e9-bdb6f0a0f983 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:09.810394 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-32d2fcaf-7f39-4070-a7e9-bdb6f0a0f983 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141" status: 200 len: 1266 microversion: 2.1 time: 0.232064 Jun 07 14:27:09.811255 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 327/623] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:09 2022] GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:27:10.812672 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-76040c9e-974b-461c-a342-a37899525bf9 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:10.813203 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-76040c9e-974b-461c-a342-a37899525bf9 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:10.819678 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-76040c9e-974b-461c-a342-a37899525bf9 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:10.820119 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-76040c9e-974b-461c-a342-a37899525bf9 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:10.820873 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-76040c9e-974b-461c-a342-a37899525bf9 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:10.821302 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-76040c9e-974b-461c-a342-a37899525bf9 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:10.826960 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=100 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:10.829781 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-04f6f37f-daf5-40bc-83c8-c10055f50a77 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:10.830399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-04f6f37f-daf5-40bc-83c8-c10055f50a77 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:10.836437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-04f6f37f-daf5-40bc-83c8-c10055f50a77 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:10.836885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-04f6f37f-daf5-40bc-83c8-c10055f50a77 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:10.837647 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-04f6f37f-daf5-40bc-83c8-c10055f50a77 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:10.838080 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-04f6f37f-daf5-40bc-83c8-c10055f50a77 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:11.028881 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-76040c9e-974b-461c-a342-a37899525bf9 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:11.032263 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-04f6f37f-daf5-40bc-83c8-c10055f50a77 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:11.036727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-76040c9e-974b-461c-a342-a37899525bf9 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1569 microversion: 2.1 time: 0.227988 Jun 07 14:27:11.037412 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 297/624] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:10 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1569 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:27:11.042680 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-04f6f37f-daf5-40bc-83c8-c10055f50a77 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141" status: 200 len: 1266 microversion: 2.1 time: 0.218369 Jun 07 14:27:11.043275 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 328/625] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:10 2022] GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:27:11.999995 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-36e4d659-468e-4246-a179-8c0591fc8f14 req-5960af4b-4eca-40f0-bf8b-f8c685fe737f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99bfe151-4396-4c86-9fb5-f26989972141", "name": "network-vif-plugged", "status": "completed", "tag": "cf62c8e3-d8c3-4512-a430-f4144559869d"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:27:12.008250 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-36e4d659-468e-4246-a179-8c0591fc8f14 req-5960af4b-4eca-40f0-bf8b-f8c685fe737f service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:12.008702 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-36e4d659-468e-4246-a179-8c0591fc8f14 req-5960af4b-4eca-40f0-bf8b-f8c685fe737f service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:12.019960 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-36e4d659-468e-4246-a179-8c0591fc8f14 req-5960af4b-4eca-40f0-bf8b-f8c685fe737f service nova] Creating event network-vif-plugged:cf62c8e3-d8c3-4512-a430-f4144559869d for instance 99bfe151-4396-4c86-9fb5-f26989972141 on hv-cinder-83608 Jun 07 14:27:12.024834 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-36e4d659-468e-4246-a179-8c0591fc8f14 req-5960af4b-4eca-40f0-bf8b-f8c685fe737f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089539 Jun 07 14:27:12.025427 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 298/626] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:27:12.054799 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-f10527e0-4f4c-4c86-a2fa-48b4e9a65109 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:12.055443 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-f10527e0-4f4c-4c86-a2fa-48b4e9a65109 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:12.060110 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f37ef6cf-6194-4894-b53c-6b0e5896c82f tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:12.061115 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f37ef6cf-6194-4894-b53c-6b0e5896c82f tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:12.063162 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f10527e0-4f4c-4c86-a2fa-48b4e9a65109 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:12.063637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f10527e0-4f4c-4c86-a2fa-48b4e9a65109 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:12.064559 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f10527e0-4f4c-4c86-a2fa-48b4e9a65109 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:12.064838 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f10527e0-4f4c-4c86-a2fa-48b4e9a65109 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:12.068196 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f37ef6cf-6194-4894-b53c-6b0e5896c82f tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:12.068649 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f37ef6cf-6194-4894-b53c-6b0e5896c82f tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:12.069419 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f37ef6cf-6194-4894-b53c-6b0e5896c82f tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:12.069851 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f37ef6cf-6194-4894-b53c-6b0e5896c82f tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:12.269229 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-f10527e0-4f4c-4c86-a2fa-48b4e9a65109 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:12.272133 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f37ef6cf-6194-4894-b53c-6b0e5896c82f tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:12.279865 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-f10527e0-4f4c-4c86-a2fa-48b4e9a65109 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1569 microversion: 2.1 time: 0.229821 Jun 07 14:27:12.287954 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f37ef6cf-6194-4894-b53c-6b0e5896c82f tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141" status: 200 len: 1266 microversion: 2.1 time: 0.225649 Jun 07 14:27:12.287954 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 299/627] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:12 2022] GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:12.288557 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 329/628] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:12 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1569 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:13.298421 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a5473055-5be1-42ef-877c-cac8a9a7b1ee tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:13.298883 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-f0331088-f97b-417a-b204-842697b99230 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:13.299277 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-f0331088-f97b-417a-b204-842697b99230 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:13.299385 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a5473055-5be1-42ef-877c-cac8a9a7b1ee tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:13.305074 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f0331088-f97b-417a-b204-842697b99230 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:13.305516 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f0331088-f97b-417a-b204-842697b99230 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:13.305630 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a5473055-5be1-42ef-877c-cac8a9a7b1ee tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:13.306038 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a5473055-5be1-42ef-877c-cac8a9a7b1ee tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:13.306268 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f0331088-f97b-417a-b204-842697b99230 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:13.306697 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f0331088-f97b-417a-b204-842697b99230 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:13.306874 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a5473055-5be1-42ef-877c-cac8a9a7b1ee tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:13.307432 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a5473055-5be1-42ef-877c-cac8a9a7b1ee tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:13.499947 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-f0331088-f97b-417a-b204-842697b99230 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:13.507583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-f0331088-f97b-417a-b204-842697b99230 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141" status: 200 len: 1266 microversion: 2.1 time: 0.212844 Jun 07 14:27:13.508163 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 330/629] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:13 2022] GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:13.509017 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a5473055-5be1-42ef-877c-cac8a9a7b1ee tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:13.516946 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a5473055-5be1-42ef-877c-cac8a9a7b1ee tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1569 microversion: 2.1 time: 0.222279 Jun 07 14:27:13.517541 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 300/630] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:13 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1569 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:14.524560 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-514c443a-0fad-42c1-8275-f61617ac0ed4 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:14.525263 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-514c443a-0fad-42c1-8275-f61617ac0ed4 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:14.531393 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-514c443a-0fad-42c1-8275-f61617ac0ed4 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:14.531846 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-514c443a-0fad-42c1-8275-f61617ac0ed4 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:14.532612 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-514c443a-0fad-42c1-8275-f61617ac0ed4 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:14.533050 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-514c443a-0fad-42c1-8275-f61617ac0ed4 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:14.534268 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-38915674-e8b6-46f0-8d6a-8923f9484f2f tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:14.534941 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-38915674-e8b6-46f0-8d6a-8923f9484f2f tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:14.542809 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-38915674-e8b6-46f0-8d6a-8923f9484f2f tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:14.543379 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-38915674-e8b6-46f0-8d6a-8923f9484f2f tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:14.544158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-38915674-e8b6-46f0-8d6a-8923f9484f2f tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:14.544593 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-38915674-e8b6-46f0-8d6a-8923f9484f2f tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:14.736415 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-514c443a-0fad-42c1-8275-f61617ac0ed4 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:14.740558 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-38915674-e8b6-46f0-8d6a-8923f9484f2f tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:14.744073 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-514c443a-0fad-42c1-8275-f61617ac0ed4 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141" status: 200 len: 1452 microversion: 2.1 time: 0.223377 Jun 07 14:27:14.745287 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 331/631] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:14 2022] GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 => generated 1452 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:14.748880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-38915674-e8b6-46f0-8d6a-8923f9484f2f tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1569 microversion: 2.1 time: 0.218925 Jun 07 14:27:14.749457 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 301/632] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:14 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:27:14.761297 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-18326d3b-da88-4a90-9cf1-fa68b1a70ff1 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:14.761951 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-18326d3b-da88-4a90-9cf1-fa68b1a70ff1 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:14.767883 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-18326d3b-da88-4a90-9cf1-fa68b1a70ff1 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:14.768327 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-18326d3b-da88-4a90-9cf1-fa68b1a70ff1 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:14.769077 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-18326d3b-da88-4a90-9cf1-fa68b1a70ff1 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:14.769509 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-18326d3b-da88-4a90-9cf1-fa68b1a70ff1 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:14.900135 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-18326d3b-da88-4a90-9cf1-fa68b1a70ff1 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:14.907709 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-18326d3b-da88-4a90-9cf1-fa68b1a70ff1 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141" status: 200 len: 1452 microversion: 2.1 time: 0.150898 Jun 07 14:27:14.908339 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 332/633] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:14 2022] GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:15.766077 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2d1e10c2-5418-4fc0-b9f8-49fe2d3ced4a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:15.766685 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2d1e10c2-5418-4fc0-b9f8-49fe2d3ced4a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:15.773188 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2d1e10c2-5418-4fc0-b9f8-49fe2d3ced4a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:15.773631 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2d1e10c2-5418-4fc0-b9f8-49fe2d3ced4a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:15.774394 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2d1e10c2-5418-4fc0-b9f8-49fe2d3ced4a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:15.774825 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2d1e10c2-5418-4fc0-b9f8-49fe2d3ced4a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:16.016375 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2d1e10c2-5418-4fc0-b9f8-49fe2d3ced4a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:16.023861 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2d1e10c2-5418-4fc0-b9f8-49fe2d3ced4a tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1569 microversion: 2.1 time: 0.261598 Jun 07 14:27:16.024435 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 302/634] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:15 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1569 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:16.619334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-773e0eec-7f5b-4cc4-bc18-eb08b5f62daf req-544f0b78-2245-4a02-a307-4f465bcafba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99bfe151-4396-4c86-9fb5-f26989972141", "tag": "cf62c8e3-d8c3-4512-a430-f4144559869d"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:27:16.628113 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-773e0eec-7f5b-4cc4-bc18-eb08b5f62daf req-544f0b78-2245-4a02-a307-4f465bcafba4 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:16.628561 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-773e0eec-7f5b-4cc4-bc18-eb08b5f62daf req-544f0b78-2245-4a02-a307-4f465bcafba4 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:16.640155 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-773e0eec-7f5b-4cc4-bc18-eb08b5f62daf req-544f0b78-2245-4a02-a307-4f465bcafba4 service nova] Creating event network-changed:cf62c8e3-d8c3-4512-a430-f4144559869d for instance 99bfe151-4396-4c86-9fb5-f26989972141 on hv-cinder-83608 Jun 07 14:27:16.645121 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-773e0eec-7f5b-4cc4-bc18-eb08b5f62daf req-544f0b78-2245-4a02-a307-4f465bcafba4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029598 Jun 07 14:27:16.645718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 333/635] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:27:17.041213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-331ab0e6-6a44-4f9b-bdd8-aec7d629d261 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:17.042117 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-331ab0e6-6a44-4f9b-bdd8-aec7d629d261 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:17.048651 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-331ab0e6-6a44-4f9b-bdd8-aec7d629d261 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:17.049223 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-331ab0e6-6a44-4f9b-bdd8-aec7d629d261 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:17.050106 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-331ab0e6-6a44-4f9b-bdd8-aec7d629d261 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:17.050711 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-331ab0e6-6a44-4f9b-bdd8-aec7d629d261 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:17.200357 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-331ab0e6-6a44-4f9b-bdd8-aec7d629d261 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:17.208801 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-331ab0e6-6a44-4f9b-bdd8-aec7d629d261 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1569 microversion: 2.1 time: 0.171490 Jun 07 14:27:17.209607 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 303/636] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:17 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:18.227841 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3462f101-0fc9-463d-b275-bfd8b5582b29 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:18.228602 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-3462f101-0fc9-463d-b275-bfd8b5582b29 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:18.234927 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3462f101-0fc9-463d-b275-bfd8b5582b29 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:18.235431 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3462f101-0fc9-463d-b275-bfd8b5582b29 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:18.236189 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3462f101-0fc9-463d-b275-bfd8b5582b29 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:18.236627 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3462f101-0fc9-463d-b275-bfd8b5582b29 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:18.368232 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-3462f101-0fc9-463d-b275-bfd8b5582b29 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:18.375725 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-3462f101-0fc9-463d-b275-bfd8b5582b29 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1569 microversion: 2.1 time: 0.152238 Jun 07 14:27:18.376288 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 334/637] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:18 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:19.392882 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7cb8e65f-4736-4b01-8706-a7aa7494bfcf tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:19.393441 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7cb8e65f-4736-4b01-8706-a7aa7494bfcf tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:19.399900 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7cb8e65f-4736-4b01-8706-a7aa7494bfcf tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:19.401057 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7cb8e65f-4736-4b01-8706-a7aa7494bfcf tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:19.401872 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7cb8e65f-4736-4b01-8706-a7aa7494bfcf tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:19.402305 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7cb8e65f-4736-4b01-8706-a7aa7494bfcf tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:19.532429 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-7cb8e65f-4736-4b01-8706-a7aa7494bfcf tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:19.539982 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7cb8e65f-4736-4b01-8706-a7aa7494bfcf tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1569 microversion: 2.1 time: 0.151061 Jun 07 14:27:19.540555 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 304/638] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:19 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:20.557442 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-bad73f84-f200-4460-834c-ad3cabb6c504 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:20.557977 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-bad73f84-f200-4460-834c-ad3cabb6c504 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:20.564140 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bad73f84-f200-4460-834c-ad3cabb6c504 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:20.564590 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bad73f84-f200-4460-834c-ad3cabb6c504 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:20.565346 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bad73f84-f200-4460-834c-ad3cabb6c504 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:20.565781 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bad73f84-f200-4460-834c-ad3cabb6c504 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:20.584102 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:20.701635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-bad73f84-f200-4460-834c-ad3cabb6c504 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:20.709076 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-bad73f84-f200-4460-834c-ad3cabb6c504 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1569 microversion: 2.1 time: 0.155794 Jun 07 14:27:20.709636 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 335/639] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:20 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:21.726612 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-11bbe008-e204-46f8-a7d9-9b7252df713c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:21.727247 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-11bbe008-e204-46f8-a7d9-9b7252df713c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:21.734567 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-11bbe008-e204-46f8-a7d9-9b7252df713c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:21.735030 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-11bbe008-e204-46f8-a7d9-9b7252df713c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:21.735840 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-11bbe008-e204-46f8-a7d9-9b7252df713c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:21.736279 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-11bbe008-e204-46f8-a7d9-9b7252df713c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:21.864127 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-11bbe008-e204-46f8-a7d9-9b7252df713c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:21.871702 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-11bbe008-e204-46f8-a7d9-9b7252df713c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1569 microversion: 2.1 time: 0.148873 Jun 07 14:27:21.872279 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 305/640] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:21 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:22.888810 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-c52da9df-aab6-416e-b8df-54573a6f31d6 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:22.889430 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-c52da9df-aab6-416e-b8df-54573a6f31d6 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:22.895663 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c52da9df-aab6-416e-b8df-54573a6f31d6 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:22.896117 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c52da9df-aab6-416e-b8df-54573a6f31d6 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:22.896887 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c52da9df-aab6-416e-b8df-54573a6f31d6 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:22.897328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c52da9df-aab6-416e-b8df-54573a6f31d6 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:23.045904 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-c52da9df-aab6-416e-b8df-54573a6f31d6 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:23.053289 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-c52da9df-aab6-416e-b8df-54573a6f31d6 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1569 microversion: 2.1 time: 0.168800 Jun 07 14:27:23.053859 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 336/641] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:22 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:24.070549 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-55810985-15ad-459b-862f-c0d46eb70c23 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:24.071161 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-55810985-15ad-459b-862f-c0d46eb70c23 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:24.078004 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-55810985-15ad-459b-862f-c0d46eb70c23 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:24.078483 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-55810985-15ad-459b-862f-c0d46eb70c23 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:24.079299 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-55810985-15ad-459b-862f-c0d46eb70c23 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:24.079735 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-55810985-15ad-459b-862f-c0d46eb70c23 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:24.209525 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-55810985-15ad-459b-862f-c0d46eb70c23 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:24.218065 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-55810985-15ad-459b-862f-c0d46eb70c23 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1510 microversion: 2.1 time: 0.151145 Jun 07 14:27:24.218638 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 306/642] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:24 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:24.241205 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ff9ba977-eeef-4e09-b92d-77d162ce4a4f tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:27:24.241806 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ff9ba977-eeef-4e09-b92d-77d162ce4a4f tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:24.247675 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ff9ba977-eeef-4e09-b92d-77d162ce4a4f tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:24.248122 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ff9ba977-eeef-4e09-b92d-77d162ce4a4f tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:24.248877 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ff9ba977-eeef-4e09-b92d-77d162ce4a4f tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:24.249313 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ff9ba977-eeef-4e09-b92d-77d162ce4a4f tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:24.337773 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ff9ba977-eeef-4e09-b92d-77d162ce4a4f tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "POST /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286/action" status: 202 len: 0 microversion: 2.1 time: 0.100374 Jun 07 14:27:24.338370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 337/643] 10.222.0.81 () {60 vars in 1277 bytes} [Tue Jun 7 14:27:24 2022] POST /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:27:24.347774 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2acf242d-52a0-4c42-9721-dc9c8458fa5b tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:24.348384 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2acf242d-52a0-4c42-9721-dc9c8458fa5b tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:24.354548 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2acf242d-52a0-4c42-9721-dc9c8458fa5b tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:24.354993 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2acf242d-52a0-4c42-9721-dc9c8458fa5b tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:24.355969 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2acf242d-52a0-4c42-9721-dc9c8458fa5b tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:24.356405 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2acf242d-52a0-4c42-9721-dc9c8458fa5b tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:24.494522 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2acf242d-52a0-4c42-9721-dc9c8458fa5b tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:24.502768 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2acf242d-52a0-4c42-9721-dc9c8458fa5b tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1518 microversion: 2.1 time: 0.159092 Jun 07 14:27:24.503359 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 307/644] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:24 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:25.521440 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-fdc37e12-7936-47f7-824e-6b0b476be272 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:25.522055 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-fdc37e12-7936-47f7-824e-6b0b476be272 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:25.529188 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fdc37e12-7936-47f7-824e-6b0b476be272 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:25.529640 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fdc37e12-7936-47f7-824e-6b0b476be272 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:25.530403 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fdc37e12-7936-47f7-824e-6b0b476be272 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:25.530838 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fdc37e12-7936-47f7-824e-6b0b476be272 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:25.669243 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-fdc37e12-7936-47f7-824e-6b0b476be272 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:25.676852 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-fdc37e12-7936-47f7-824e-6b0b476be272 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1520 microversion: 2.1 time: 0.159496 Jun 07 14:27:25.677423 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 338/645] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:25 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:26.696016 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-96486513-afe6-4516-80a0-576ce8c36a4d tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:26.697406 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-96486513-afe6-4516-80a0-576ce8c36a4d tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:26.705428 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-96486513-afe6-4516-80a0-576ce8c36a4d tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:26.706181 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-96486513-afe6-4516-80a0-576ce8c36a4d tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:26.708144 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-96486513-afe6-4516-80a0-576ce8c36a4d tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:26.708595 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-96486513-afe6-4516-80a0-576ce8c36a4d tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:26.948459 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-96486513-afe6-4516-80a0-576ce8c36a4d tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:26.956356 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-96486513-afe6-4516-80a0-576ce8c36a4d tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1576 microversion: 2.1 time: 0.265699 Jun 07 14:27:26.956924 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 308/646] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:26 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1576 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:27.968073 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-4d822d72-36f5-4b8d-9a0f-a5dd194bd008 req-c870e7d2-0ce5-4a32-9227-c8f2a27ccf69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2714c53-3b93-4d50-9812-e5f0a324b286", "name": "network-vif-unplugged", "status": "completed", "tag": "cd19e240-c912-408d-ac68-5ada3a1dd139"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:27:27.975165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-10b936d9-375e-4514-8348-6a4abc43ee41 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:27.975922 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-10b936d9-375e-4514-8348-6a4abc43ee41 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:27.976608 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-4d822d72-36f5-4b8d-9a0f-a5dd194bd008 req-c870e7d2-0ce5-4a32-9227-c8f2a27ccf69 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:27.977262 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-4d822d72-36f5-4b8d-9a0f-a5dd194bd008 req-c870e7d2-0ce5-4a32-9227-c8f2a27ccf69 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:27.983291 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-10b936d9-375e-4514-8348-6a4abc43ee41 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:27.983789 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-10b936d9-375e-4514-8348-6a4abc43ee41 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:27.984662 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-10b936d9-375e-4514-8348-6a4abc43ee41 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:27.985110 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-10b936d9-375e-4514-8348-6a4abc43ee41 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:27.991689 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-4d822d72-36f5-4b8d-9a0f-a5dd194bd008 req-c870e7d2-0ce5-4a32-9227-c8f2a27ccf69 service nova] Creating event network-vif-unplugged:cd19e240-c912-408d-ac68-5ada3a1dd139 for instance e2714c53-3b93-4d50-9812-e5f0a324b286 on hv-cinder-83608 Jun 07 14:27:27.998474 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-4d822d72-36f5-4b8d-9a0f-a5dd194bd008 req-c870e7d2-0ce5-4a32-9227-c8f2a27ccf69 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034026 Jun 07 14:27:27.999259 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 339/647] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:27:28.116398 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-10b936d9-375e-4514-8348-6a4abc43ee41 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:28.124392 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-10b936d9-375e-4514-8348-6a4abc43ee41 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1576 microversion: 2.1 time: 0.153315 Jun 07 14:27:28.124972 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 309/648] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:27 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:27:28.619105 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-dbc8c63e-ff63-4303-bf10-38f98b0d4f8f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:28.619714 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-dbc8c63e-ff63-4303-bf10-38f98b0d4f8f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:28.626562 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-dbc8c63e-ff63-4303-bf10-38f98b0d4f8f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:28.627009 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-dbc8c63e-ff63-4303-bf10-38f98b0d4f8f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:28.627794 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-dbc8c63e-ff63-4303-bf10-38f98b0d4f8f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:28.628226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-dbc8c63e-ff63-4303-bf10-38f98b0d4f8f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:28.708484 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.objects.instance [None req-dbc8c63e-ff63-4303-bf10-38f98b0d4f8f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lazy-loading 'services' on Instance uuid 2740b69b-07ea-4b16-ae3d-3b964bc65edd {{(pid=117565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:27:28.777610 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-dbc8c63e-ff63-4303-bf10-38f98b0d4f8f tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "DELETE /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd/os-volume_attachments/4b86732f-24bd-4813-91d4-7eef0779dd78" status: 202 len: 0 microversion: 2.1 time: 0.162271 Jun 07 14:27:28.778199 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 340/649] 10.222.0.81 () {58 vars in 1415 bytes} [Tue Jun 7 14:27:28 2022] DELETE /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd/os-volume_attachments/4b86732f-24bd-4813-91d4-7eef0779dd78 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:27:28.786582 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7978a453-bfc1-4d46-8581-b6b27cfd5fe1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:28.787587 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7978a453-bfc1-4d46-8581-b6b27cfd5fe1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:28.794184 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7978a453-bfc1-4d46-8581-b6b27cfd5fe1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:28.794678 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7978a453-bfc1-4d46-8581-b6b27cfd5fe1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:28.795601 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7978a453-bfc1-4d46-8581-b6b27cfd5fe1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:28.796087 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7978a453-bfc1-4d46-8581-b6b27cfd5fe1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:28.826854 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7978a453-bfc1-4d46-8581-b6b27cfd5fe1 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044043 Jun 07 14:27:28.827358 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 310/650] 10.222.0.81 () {58 vars in 1301 bytes} [Tue Jun 7 14:27:28 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:27:29.148700 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-b7ca36c7-d4ed-44cf-8b09-45fead8e47b1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:29.149308 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-b7ca36c7-d4ed-44cf-8b09-45fead8e47b1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:29.156510 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b7ca36c7-d4ed-44cf-8b09-45fead8e47b1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:29.156951 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b7ca36c7-d4ed-44cf-8b09-45fead8e47b1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:29.157709 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b7ca36c7-d4ed-44cf-8b09-45fead8e47b1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:29.158133 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b7ca36c7-d4ed-44cf-8b09-45fead8e47b1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:29.288291 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-b7ca36c7-d4ed-44cf-8b09-45fead8e47b1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:29.296652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-b7ca36c7-d4ed-44cf-8b09-45fead8e47b1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1576 microversion: 2.1 time: 0.152179 Jun 07 14:27:29.297224 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 341/651] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:29 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:29.837978 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0304dc29-46d5-43b1-a64c-8651b0a11662 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:29.838822 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0304dc29-46d5-43b1-a64c-8651b0a11662 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:29.845971 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0304dc29-46d5-43b1-a64c-8651b0a11662 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:29.846420 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0304dc29-46d5-43b1-a64c-8651b0a11662 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:29.847176 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0304dc29-46d5-43b1-a64c-8651b0a11662 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:29.847648 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0304dc29-46d5-43b1-a64c-8651b0a11662 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:29.876067 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0304dc29-46d5-43b1-a64c-8651b0a11662 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042118 Jun 07 14:27:29.876618 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 311/652] 10.222.0.81 () {58 vars in 1301 bytes} [Tue Jun 7 14:27:29 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 14:27:29.952756 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-80c73324-9d63-476b-8628-844cc599c71b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:29.953254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-80c73324-9d63-476b-8628-844cc599c71b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:29.959244 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-80c73324-9d63-476b-8628-844cc599c71b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:29.959708 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-80c73324-9d63-476b-8628-844cc599c71b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:29.960467 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-80c73324-9d63-476b-8628-844cc599c71b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:29.960904 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-80c73324-9d63-476b-8628-844cc599c71b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:29.985095 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-80c73324-9d63-476b-8628-844cc599c71b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Going to try to terminate instance {{(pid=117565) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:27:30.059057 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-80c73324-9d63-476b-8628-844cc599c71b tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "DELETE /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 204 len: 0 microversion: 2.1 time: 0.109992 Jun 07 14:27:30.059659 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 342/653] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:27:29 2022] DELETE /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:27:30.067576 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-58b7ec53-d6b5-4f30-834d-d709deb28d61 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:30.068195 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-58b7ec53-d6b5-4f30-834d-d709deb28d61 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:30.077006 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-58b7ec53-d6b5-4f30-834d-d709deb28d61 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:30.077792 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-58b7ec53-d6b5-4f30-834d-d709deb28d61 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:30.078568 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-58b7ec53-d6b5-4f30-834d-d709deb28d61 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:30.079002 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-58b7ec53-d6b5-4f30-834d-d709deb28d61 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:30.211204 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-58b7ec53-d6b5-4f30-834d-d709deb28d61 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:30.219714 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-58b7ec53-d6b5-4f30-834d-d709deb28d61 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1686 microversion: 2.1 time: 0.155959 Jun 07 14:27:30.220283 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 312/654] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:30 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:30.314552 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-426f01bf-0f1c-457a-b2e6-9fc9afab59d2 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:30.315277 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-426f01bf-0f1c-457a-b2e6-9fc9afab59d2 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:30.321183 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-426f01bf-0f1c-457a-b2e6-9fc9afab59d2 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:30.321630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-426f01bf-0f1c-457a-b2e6-9fc9afab59d2 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:30.322385 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-426f01bf-0f1c-457a-b2e6-9fc9afab59d2 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:30.322818 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-426f01bf-0f1c-457a-b2e6-9fc9afab59d2 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:30.454668 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-426f01bf-0f1c-457a-b2e6-9fc9afab59d2 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:30.462131 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-426f01bf-0f1c-457a-b2e6-9fc9afab59d2 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1576 microversion: 2.1 time: 0.151752 Jun 07 14:27:30.462701 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 343/655] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:30 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:31.236586 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5f4fee40-4806-49d3-b0c3-7c096bfe35da tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:31.237209 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-5f4fee40-4806-49d3-b0c3-7c096bfe35da tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:31.243750 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5f4fee40-4806-49d3-b0c3-7c096bfe35da tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:31.244197 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5f4fee40-4806-49d3-b0c3-7c096bfe35da tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:31.244967 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5f4fee40-4806-49d3-b0c3-7c096bfe35da tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:31.245940 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5f4fee40-4806-49d3-b0c3-7c096bfe35da tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:31.377566 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5f4fee40-4806-49d3-b0c3-7c096bfe35da tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:31.385027 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-5f4fee40-4806-49d3-b0c3-7c096bfe35da tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1686 microversion: 2.1 time: 0.152322 Jun 07 14:27:31.385590 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 313/656] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:31 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:31.479717 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-2fdc187c-3388-4299-a3f3-f034800d8ded tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:31.480649 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-2fdc187c-3388-4299-a3f3-f034800d8ded tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:31.486678 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2fdc187c-3388-4299-a3f3-f034800d8ded tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:31.487126 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2fdc187c-3388-4299-a3f3-f034800d8ded tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:31.487930 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2fdc187c-3388-4299-a3f3-f034800d8ded tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:31.488363 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2fdc187c-3388-4299-a3f3-f034800d8ded tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:31.619506 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-2fdc187c-3388-4299-a3f3-f034800d8ded tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:31.627581 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-2fdc187c-3388-4299-a3f3-f034800d8ded tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1576 microversion: 2.1 time: 0.151726 Jun 07 14:27:31.628141 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 344/657] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:31 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:32.401977 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-61acf363-6cb7-4fb9-aefe-e713a4655122 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:32.402584 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-61acf363-6cb7-4fb9-aefe-e713a4655122 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:32.409214 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-61acf363-6cb7-4fb9-aefe-e713a4655122 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:32.409665 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-61acf363-6cb7-4fb9-aefe-e713a4655122 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:32.410424 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-61acf363-6cb7-4fb9-aefe-e713a4655122 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:32.410863 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-61acf363-6cb7-4fb9-aefe-e713a4655122 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:32.428970 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=100 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:32.537915 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-61acf363-6cb7-4fb9-aefe-e713a4655122 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:32.546117 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-61acf363-6cb7-4fb9-aefe-e713a4655122 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1686 microversion: 2.1 time: 0.148148 Jun 07 14:27:32.546691 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 314/658] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:32 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1686 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:32.644711 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ca9e1889-fee1-49c9-b3b2-11bef0935894 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:32.645333 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ca9e1889-fee1-49c9-b3b2-11bef0935894 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:32.651453 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ca9e1889-fee1-49c9-b3b2-11bef0935894 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:32.652064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ca9e1889-fee1-49c9-b3b2-11bef0935894 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:32.652747 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ca9e1889-fee1-49c9-b3b2-11bef0935894 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:32.653178 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ca9e1889-fee1-49c9-b3b2-11bef0935894 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:32.800416 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ca9e1889-fee1-49c9-b3b2-11bef0935894 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:32.808242 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ca9e1889-fee1-49c9-b3b2-11bef0935894 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1576 microversion: 2.1 time: 0.167402 Jun 07 14:27:32.808800 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 345/659] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:32 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:33.563654 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-afaa2158-d16e-4e0e-9cdd-87e6de9c11d4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:33.564302 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-afaa2158-d16e-4e0e-9cdd-87e6de9c11d4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:33.570735 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-afaa2158-d16e-4e0e-9cdd-87e6de9c11d4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:33.571183 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-afaa2158-d16e-4e0e-9cdd-87e6de9c11d4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:33.571977 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-afaa2158-d16e-4e0e-9cdd-87e6de9c11d4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:33.572417 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-afaa2158-d16e-4e0e-9cdd-87e6de9c11d4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:33.701358 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-afaa2158-d16e-4e0e-9cdd-87e6de9c11d4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:33.708992 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-afaa2158-d16e-4e0e-9cdd-87e6de9c11d4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1686 microversion: 2.1 time: 0.149258 Jun 07 14:27:33.709556 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 315/660] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:33 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1686 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:27:33.825820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-17379b0a-192b-41e0-91e8-41dbe7c7a1ec tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:33.826347 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-17379b0a-192b-41e0-91e8-41dbe7c7a1ec tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:33.833020 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-17379b0a-192b-41e0-91e8-41dbe7c7a1ec tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:33.833481 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-17379b0a-192b-41e0-91e8-41dbe7c7a1ec tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:33.834291 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-17379b0a-192b-41e0-91e8-41dbe7c7a1ec tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:33.834846 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-17379b0a-192b-41e0-91e8-41dbe7c7a1ec tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:33.970640 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-17379b0a-192b-41e0-91e8-41dbe7c7a1ec tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:33.978020 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-17379b0a-192b-41e0-91e8-41dbe7c7a1ec tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1576 microversion: 2.1 time: 0.156777 Jun 07 14:27:33.978572 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 346/661] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:33 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:34.725800 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9722e3bb-9b89-4cc8-9aa8-16a77276a41d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:34.726411 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9722e3bb-9b89-4cc8-9aa8-16a77276a41d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:34.733410 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9722e3bb-9b89-4cc8-9aa8-16a77276a41d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:34.733860 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9722e3bb-9b89-4cc8-9aa8-16a77276a41d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:34.734611 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9722e3bb-9b89-4cc8-9aa8-16a77276a41d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:34.735044 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9722e3bb-9b89-4cc8-9aa8-16a77276a41d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:34.863998 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9722e3bb-9b89-4cc8-9aa8-16a77276a41d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:34.872232 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9722e3bb-9b89-4cc8-9aa8-16a77276a41d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1686 microversion: 2.1 time: 0.150304 Jun 07 14:27:34.872809 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 316/662] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:34 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1686 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:34.994939 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-1f1f1b13-98b7-4984-925d-9cb9b711fcbe tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:34.995852 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-1f1f1b13-98b7-4984-925d-9cb9b711fcbe tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:34.997849 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:35.003986 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1f1f1b13-98b7-4984-925d-9cb9b711fcbe tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:35.004440 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1f1f1b13-98b7-4984-925d-9cb9b711fcbe tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:35.005208 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1f1f1b13-98b7-4984-925d-9cb9b711fcbe tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:35.005650 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1f1f1b13-98b7-4984-925d-9cb9b711fcbe tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:35.136342 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-1f1f1b13-98b7-4984-925d-9cb9b711fcbe tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:35.144045 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-1f1f1b13-98b7-4984-925d-9cb9b711fcbe tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1576 microversion: 2.1 time: 0.152865 Jun 07 14:27:35.144619 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 347/663] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:34 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:35.889245 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9c4592fc-5c9b-4ee1-91f3-effd7e9deef6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:35.889862 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9c4592fc-5c9b-4ee1-91f3-effd7e9deef6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:35.896714 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9c4592fc-5c9b-4ee1-91f3-effd7e9deef6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:35.897164 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9c4592fc-5c9b-4ee1-91f3-effd7e9deef6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:35.898132 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9c4592fc-5c9b-4ee1-91f3-effd7e9deef6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:35.898577 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9c4592fc-5c9b-4ee1-91f3-effd7e9deef6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:36.093552 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9c4592fc-5c9b-4ee1-91f3-effd7e9deef6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:36.102408 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9c4592fc-5c9b-4ee1-91f3-effd7e9deef6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1686 microversion: 2.1 time: 0.217052 Jun 07 14:27:36.103001 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 317/664] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:35 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1686 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:36.161707 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-c1c715f5-1ebf-4df8-9557-6cff77278d29 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:36.162317 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-c1c715f5-1ebf-4df8-9557-6cff77278d29 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:36.170911 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c1c715f5-1ebf-4df8-9557-6cff77278d29 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:36.171390 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c1c715f5-1ebf-4df8-9557-6cff77278d29 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:36.172166 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c1c715f5-1ebf-4df8-9557-6cff77278d29 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:36.172605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c1c715f5-1ebf-4df8-9557-6cff77278d29 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:36.384858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-c1c715f5-1ebf-4df8-9557-6cff77278d29 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:36.392391 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-c1c715f5-1ebf-4df8-9557-6cff77278d29 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1576 microversion: 2.1 time: 0.234529 Jun 07 14:27:36.392964 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 348/665] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:36 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:36.495855 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-ec98370f-c920-4dca-a6e8-3d036b5512cd req-e4d95353-5779-4d2a-8861-a72b5bae9b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2740b69b-07ea-4b16-ae3d-3b964bc65edd", "name": "network-vif-deleted", "tag": "44ff486f-5bc3-4d1b-9ece-149684ef12b7"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:27:36.504301 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-ec98370f-c920-4dca-a6e8-3d036b5512cd req-e4d95353-5779-4d2a-8861-a72b5bae9b70 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:36.504876 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-ec98370f-c920-4dca-a6e8-3d036b5512cd req-e4d95353-5779-4d2a-8861-a72b5bae9b70 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:36.521517 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-ec98370f-c920-4dca-a6e8-3d036b5512cd req-e4d95353-5779-4d2a-8861-a72b5bae9b70 service nova] Creating event network-vif-deleted:44ff486f-5bc3-4d1b-9ece-149684ef12b7 for instance 2740b69b-07ea-4b16-ae3d-3b964bc65edd on hv-cinder-83608 Jun 07 14:27:36.528256 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-ec98370f-c920-4dca-a6e8-3d036b5512cd req-e4d95353-5779-4d2a-8861-a72b5bae9b70 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034846 Jun 07 14:27:36.531939 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 318/666] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:27:37.120673 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-8048be16-639a-4b15-a3fc-a6cc038f3ad2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:37.121621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-8048be16-639a-4b15-a3fc-a6cc038f3ad2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:37.128427 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8048be16-639a-4b15-a3fc-a6cc038f3ad2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:37.129170 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8048be16-639a-4b15-a3fc-a6cc038f3ad2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:37.130495 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8048be16-639a-4b15-a3fc-a6cc038f3ad2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:37.131029 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8048be16-639a-4b15-a3fc-a6cc038f3ad2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:37.152654 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:37.186729 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8048be16-639a-4b15-a3fc-a6cc038f3ad2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:37.188755 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8048be16-639a-4b15-a3fc-a6cc038f3ad2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:37.189471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.objects.instance [None req-8048be16-639a-4b15-a3fc-a6cc038f3ad2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lazy-loading 'fault' on Instance uuid 2740b69b-07ea-4b16-ae3d-3b964bc65edd {{(pid=117565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:27:37.235017 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8048be16-639a-4b15-a3fc-a6cc038f3ad2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:37.242363 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-8048be16-639a-4b15-a3fc-a6cc038f3ad2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 200 len: 1334 microversion: 2.1 time: 0.125775 Jun 07 14:27:37.242932 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 349/667] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:37 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 1334 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:37.410891 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8b80370e-81fa-4ea5-87fe-8a67eb5f4dcb tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:37.411627 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8b80370e-81fa-4ea5-87fe-8a67eb5f4dcb tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:37.413533 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=50 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:37.420010 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8b80370e-81fa-4ea5-87fe-8a67eb5f4dcb tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:37.420589 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8b80370e-81fa-4ea5-87fe-8a67eb5f4dcb tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:37.421484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8b80370e-81fa-4ea5-87fe-8a67eb5f4dcb tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:37.421989 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8b80370e-81fa-4ea5-87fe-8a67eb5f4dcb tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:37.557287 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8b80370e-81fa-4ea5-87fe-8a67eb5f4dcb tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:37.566352 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8b80370e-81fa-4ea5-87fe-8a67eb5f4dcb tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1563 microversion: 2.1 time: 0.160044 Jun 07 14:27:37.567044 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 319/668] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:37 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:38.044870 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-d45af00b-ac2f-4366-bb1d-5125c5aeaf6e req-7e8a3689-d027-4843-b847-0b41d50b683a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2714c53-3b93-4d50-9812-e5f0a324b286", "name": "network-vif-plugged", "status": "completed", "tag": "cd19e240-c912-408d-ac68-5ada3a1dd139"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:27:38.053201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-d45af00b-ac2f-4366-bb1d-5125c5aeaf6e req-7e8a3689-d027-4843-b847-0b41d50b683a service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:38.053645 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-d45af00b-ac2f-4366-bb1d-5125c5aeaf6e req-7e8a3689-d027-4843-b847-0b41d50b683a service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:38.065183 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-d45af00b-ac2f-4366-bb1d-5125c5aeaf6e req-7e8a3689-d027-4843-b847-0b41d50b683a service nova] Creating event network-vif-plugged:cd19e240-c912-408d-ac68-5ada3a1dd139 for instance e2714c53-3b93-4d50-9812-e5f0a324b286 on hv-cinder-83608 Jun 07 14:27:38.070148 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-d45af00b-ac2f-4366-bb1d-5125c5aeaf6e req-7e8a3689-d027-4843-b847-0b41d50b683a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029653 Jun 07 14:27:38.070945 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 350/669] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:27:38.259014 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-14bc1dd7-d6de-48ed-bacc-65bfea3adff6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:38.259652 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-14bc1dd7-d6de-48ed-bacc-65bfea3adff6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 2740b69b-07ea-4b16-ae3d-3b964bc65edd] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:38.265773 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-14bc1dd7-d6de-48ed-bacc-65bfea3adff6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:38.266234 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-14bc1dd7-d6de-48ed-bacc-65bfea3adff6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:38.266999 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-14bc1dd7-d6de-48ed-bacc-65bfea3adff6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:38.267470 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-14bc1dd7-d6de-48ed-bacc-65bfea3adff6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:38.283550 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-14bc1dd7-d6de-48ed-bacc-65bfea3adff6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] HTTP exception thrown: Instance 2740b69b-07ea-4b16-ae3d-3b964bc65edd could not be found. Jun 07 14:27:38.285158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-14bc1dd7-d6de-48ed-bacc-65bfea3adff6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Request method failure captured: Jun 07 14:27:38.285158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd HTTP/1.1 Jun 07 14:27:38.285158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 07 14:27:38.285158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 07 14:27:38.285158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Connection: close Jun 07 14:27:38.285158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 07 14:27:38.285158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 07 14:27:38.285158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Host: 10.222.0.81 Jun 07 14:27:38.285158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 07 14:27:38.285158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 07 14:27:38.285158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABin17phWIJ_eQLsN9FOFsHWkCoa6NydW99S4V4yhx6nzXRUhevbmuM6FHueSJUBAhq0lRznadD50RBaf_KCwvLxd5hok2blY9CUWxTTfms_YMLnlhwe8EVLpd2UFPRe-bhvJMSOHgvXQUvrD7rxrLP2RKctJbF_rKq76mqAGT8baB5Tpo Jun 07 14:27:38.285158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 07 14:27:38.285158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 07 14:27:38.285158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 07 14:27:38.285158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 07 14:27:38.285158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 07 14:27:38.285158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 07 14:27:38.285158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Id: ec8e48464f6a4d1886aaf89cc8b28e5f Jun 07 14:27:38.285158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-444301016 Jun 07 14:27:38.285158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Role: member,reader Jun 07 14:27:38.285158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Roles: member,reader Jun 07 14:27:38.286734 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ec8e48464f6a4d1886aaf89cc8b28e5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ec8e48464f6a4d1886aaf89cc8b28e5f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ec8e48464f6a4d1886aaf89cc8b28e5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ec8e48464f6a4d1886aaf89cc8b28e5f"}]}] Jun 07 14:27:38.286734 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-ServerRescueNegativeTestJSON-444301016 Jun 07 14:27:38.286734 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Id: ec8e48464f6a4d1886aaf89cc8b28e5f Jun 07 14:27:38.286734 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-444301016 Jun 07 14:27:38.286734 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User: tempest-ServerRescueNegativeTestJSON-444301016-project Jun 07 14:27:38.286734 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 07 14:27:38.286734 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 07 14:27:38.286734 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Id: d20025ab12f4450da20c8e41b931b5fc Jun 07 14:27:38.286734 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-ServerRescueNegativeTestJSON-444301016-project Jun 07 14:27:38.286734 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: method: > Jun 07 14:27:38.286734 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: exception: Instance 2740b69b-07ea-4b16-ae3d-3b964bc65edd could not be found. Jun 07 14:27:38.286734 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: action_args: {'id': '2740b69b-07ea-4b16-ae3d-3b964bc65edd'} Jun 07 14:27:38.287596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:27:38.287596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:27:38.287596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:27:38.287596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:27:38.287596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:27:38.287596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:27:38.287596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:27:38.287596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:27:38.287596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:27:38.287596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:27:38.287596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2740b69b-07ea-4b16-ae3d-3b964bc65edd could not be found. Jun 07 14:27:38.287596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:27:38.287596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:27:38.287596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:27:38.287596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:27:38.287596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:27:38.287596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:27:38.287596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:27:38.287596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:27:38.287596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:27:38.288833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:27:38.288833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:27:38.288833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:27:38.288833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:27:38.288833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:27:38.288833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:27:38.288833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:27:38.288833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2740b69b-07ea-4b16-ae3d-3b964bc65edd could not be found. Jun 07 14:27:38.288833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:27:38.288833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:27:38.288833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:27:38.288833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:27:38.288833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:27:38.288833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:27:38.288833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:27:38.288833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:27:38.288833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2740b69b-07ea-4b16-ae3d-3b964bc65edd could not be found. Jun 07 14:27:38.288833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:27:38.289949 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-14bc1dd7-d6de-48ed-bacc-65bfea3adff6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Returning 404 to user: Instance 2740b69b-07ea-4b16-ae3d-3b964bc65edd could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:27:38.289949 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-14bc1dd7-d6de-48ed-bacc-65bfea3adff6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd" status: 404 len: 111 microversion: 2.1 time: 0.031433 Jun 07 14:27:38.289949 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 320/670] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:38 2022] GET /compute/v2.1/servers/2740b69b-07ea-4b16-ae3d-3b964bc65edd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:27:38.296364 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-eb5680c7-cac6-4d02-b64a-26f87e81493c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '.version_select at 0x7ff37f6664c0>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:38.318786 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-eb5680c7-cac6-4d02-b64a-26f87e81493c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-598497199" status: 202 len: 0 microversion: 2.1 time: 0.027356 Jun 07 14:27:38.319409 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 351/671] 10.222.0.81 () {58 vars in 1217 bytes} [Tue Jun 7 14:27:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-598497199 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:27:41.164232 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2422e887-3994-4d42-84ba-11c8f8e4eed6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:41.164732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2422e887-3994-4d42-84ba-11c8f8e4eed6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:41.171977 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2422e887-3994-4d42-84ba-11c8f8e4eed6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:41.172420 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2422e887-3994-4d42-84ba-11c8f8e4eed6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:41.173179 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2422e887-3994-4d42-84ba-11c8f8e4eed6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:41.173610 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2422e887-3994-4d42-84ba-11c8f8e4eed6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:41.197801 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2422e887-3994-4d42-84ba-11c8f8e4eed6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Going to try to terminate instance {{(pid=117564) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:27:41.269664 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2422e887-3994-4d42-84ba-11c8f8e4eed6 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "DELETE /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 204 len: 0 microversion: 2.1 time: 0.108906 Jun 07 14:27:41.270253 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 321/672] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:27:41 2022] DELETE /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:27:41.279272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-df696785-2ef7-4372-9cd6-3743f31397b4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:41.280004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-df696785-2ef7-4372-9cd6-3743f31397b4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:41.286061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-df696785-2ef7-4372-9cd6-3743f31397b4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:41.286508 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-df696785-2ef7-4372-9cd6-3743f31397b4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:41.287298 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-df696785-2ef7-4372-9cd6-3743f31397b4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:41.287728 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-df696785-2ef7-4372-9cd6-3743f31397b4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:41.416564 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-df696785-2ef7-4372-9cd6-3743f31397b4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:41.423998 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-df696785-2ef7-4372-9cd6-3743f31397b4 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1505 microversion: 2.1 time: 0.149531 Jun 07 14:27:41.424563 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 352/673] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:41 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:42.441564 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2c8b8434-d536-4286-8862-b9a4f9c25915 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:42.442181 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2c8b8434-d536-4286-8862-b9a4f9c25915 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:42.448741 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2c8b8434-d536-4286-8862-b9a4f9c25915 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:42.449197 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2c8b8434-d536-4286-8862-b9a4f9c25915 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:42.450053 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2c8b8434-d536-4286-8862-b9a4f9c25915 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:42.450486 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2c8b8434-d536-4286-8862-b9a4f9c25915 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:42.580555 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2c8b8434-d536-4286-8862-b9a4f9c25915 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:42.587957 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2c8b8434-d536-4286-8862-b9a4f9c25915 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1505 microversion: 2.1 time: 0.150738 Jun 07 14:27:42.588523 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 322/674] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:42 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:43.198777 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-289331bd-e4cf-44ed-9963-13d713449984 req-eccf25ed-61db-43e5-a4c8-0a4071e0a46e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86529cf4-f4ef-45bc-9f34-e0d802dbd846", "name": "network-vif-deleted", "tag": "dc669f0a-bd03-4ab4-a4df-85d77316b878"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:27:43.210464 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-289331bd-e4cf-44ed-9963-13d713449984 req-eccf25ed-61db-43e5-a4c8-0a4071e0a46e service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:43.210913 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-289331bd-e4cf-44ed-9963-13d713449984 req-eccf25ed-61db-43e5-a4c8-0a4071e0a46e service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:43.223600 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-289331bd-e4cf-44ed-9963-13d713449984 req-eccf25ed-61db-43e5-a4c8-0a4071e0a46e service nova] Creating event network-vif-deleted:dc669f0a-bd03-4ab4-a4df-85d77316b878 for instance 86529cf4-f4ef-45bc-9f34-e0d802dbd846 on hv-cinder-83608 Jun 07 14:27:43.228453 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-289331bd-e4cf-44ed-9963-13d713449984 req-eccf25ed-61db-43e5-a4c8-0a4071e0a46e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033277 Jun 07 14:27:43.229285 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 353/675] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:27:43.605532 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-15ffae6d-927e-49ce-8b28-6f44f2768f7c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:43.606700 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-15ffae6d-927e-49ce-8b28-6f44f2768f7c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:43.613365 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-15ffae6d-927e-49ce-8b28-6f44f2768f7c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:43.613829 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-15ffae6d-927e-49ce-8b28-6f44f2768f7c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:43.614586 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-15ffae6d-927e-49ce-8b28-6f44f2768f7c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:43.615021 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-15ffae6d-927e-49ce-8b28-6f44f2768f7c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:43.646553 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-15ffae6d-927e-49ce-8b28-6f44f2768f7c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:43.647004 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-15ffae6d-927e-49ce-8b28-6f44f2768f7c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:43.647484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-15ffae6d-927e-49ce-8b28-6f44f2768f7c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lazy-loading 'fault' on Instance uuid 86529cf4-f4ef-45bc-9f34-e0d802dbd846 {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:27:43.690420 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-15ffae6d-927e-49ce-8b28-6f44f2768f7c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:43.699667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-15ffae6d-927e-49ce-8b28-6f44f2768f7c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 200 len: 1310 microversion: 2.1 time: 0.097744 Jun 07 14:27:43.701086 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 323/676] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:43 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 1310 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:44.720486 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-0f60c744-d954-4415-a4cd-2dc4fcb6473c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:44.721174 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-0f60c744-d954-4415-a4cd-2dc4fcb6473c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 86529cf4-f4ef-45bc-9f34-e0d802dbd846] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:44.727954 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0f60c744-d954-4415-a4cd-2dc4fcb6473c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:44.728398 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0f60c744-d954-4415-a4cd-2dc4fcb6473c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:44.729160 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0f60c744-d954-4415-a4cd-2dc4fcb6473c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:44.729660 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0f60c744-d954-4415-a4cd-2dc4fcb6473c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:44.744811 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-0f60c744-d954-4415-a4cd-2dc4fcb6473c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] HTTP exception thrown: Instance 86529cf4-f4ef-45bc-9f34-e0d802dbd846 could not be found. Jun 07 14:27:44.747597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-0f60c744-d954-4415-a4cd-2dc4fcb6473c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Request method failure captured: Jun 07 14:27:44.747597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 HTTP/1.1 Jun 07 14:27:44.747597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:27:44.747597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:27:44.747597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:27:44.747597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:27:44.747597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:27:44.747597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:27:44.747597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:27:44.747597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:27:44.747597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin17phWIJ_eQLsN9FOFsHWkCoa6NydW99S4V4yhx6nzXRUhevbmuM6FHueSJUBAhq0lRznadD50RBaf_KCwvLxd5hok2blY9CUWxTTfms_YMLnlhwe8EVLpd2UFPRe-bhvJMSOHgvXQUvrD7rxrLP2RKctJbF_rKq76mqAGT8baB5Tpo Jun 07 14:27:44.747597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:27:44.747597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:27:44.747597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:27:44.747597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:27:44.747597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:27:44.747597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:27:44.747597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: ec8e48464f6a4d1886aaf89cc8b28e5f Jun 07 14:27:44.747597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-444301016 Jun 07 14:27:44.747597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:27:44.747597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:27:44.749330 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ec8e48464f6a4d1886aaf89cc8b28e5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ec8e48464f6a4d1886aaf89cc8b28e5f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ec8e48464f6a4d1886aaf89cc8b28e5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ec8e48464f6a4d1886aaf89cc8b28e5f"}]}] Jun 07 14:27:44.749330 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-ServerRescueNegativeTestJSON-444301016 Jun 07 14:27:44.749330 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: ec8e48464f6a4d1886aaf89cc8b28e5f Jun 07 14:27:44.749330 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-444301016 Jun 07 14:27:44.749330 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-ServerRescueNegativeTestJSON-444301016-project Jun 07 14:27:44.749330 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:27:44.749330 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:27:44.749330 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: d20025ab12f4450da20c8e41b931b5fc Jun 07 14:27:44.749330 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-ServerRescueNegativeTestJSON-444301016-project Jun 07 14:27:44.749330 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:27:44.749330 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance 86529cf4-f4ef-45bc-9f34-e0d802dbd846 could not be found. Jun 07 14:27:44.749330 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': '86529cf4-f4ef-45bc-9f34-e0d802dbd846'} Jun 07 14:27:44.750307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:27:44.750307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:27:44.750307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:27:44.750307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:27:44.750307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:27:44.750307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:27:44.750307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:27:44.750307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:27:44.750307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:27:44.750307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:27:44.750307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86529cf4-f4ef-45bc-9f34-e0d802dbd846 could not be found. Jun 07 14:27:44.750307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:27:44.750307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:27:44.750307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:27:44.750307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:27:44.750307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:27:44.750307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:27:44.750307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:27:44.750307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:27:44.750307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:27:44.752049 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:27:44.752049 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:27:44.752049 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:27:44.752049 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:27:44.752049 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:27:44.752049 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:27:44.752049 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:27:44.752049 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86529cf4-f4ef-45bc-9f34-e0d802dbd846 could not be found. Jun 07 14:27:44.752049 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:27:44.752049 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:27:44.752049 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:27:44.752049 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:27:44.752049 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:27:44.752049 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:27:44.752049 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:27:44.752049 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:27:44.752049 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86529cf4-f4ef-45bc-9f34-e0d802dbd846 could not be found. Jun 07 14:27:44.752049 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:27:44.753409 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-0f60c744-d954-4415-a4cd-2dc4fcb6473c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Returning 404 to user: Instance 86529cf4-f4ef-45bc-9f34-e0d802dbd846 could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:27:44.753409 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-0f60c744-d954-4415-a4cd-2dc4fcb6473c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846" status: 404 len: 111 microversion: 2.1 time: 0.034041 Jun 07 14:27:44.753409 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 354/677] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:44 2022] GET /compute/v2.1/servers/86529cf4-f4ef-45bc-9f34-e0d802dbd846 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:27:44.758862 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ac5aa306-be96-4223-8520-605055b3f2b2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:44.759408 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ac5aa306-be96-4223-8520-605055b3f2b2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:44.766551 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ac5aa306-be96-4223-8520-605055b3f2b2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:44.767113 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ac5aa306-be96-4223-8520-605055b3f2b2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:44.767957 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ac5aa306-be96-4223-8520-605055b3f2b2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:44.768392 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ac5aa306-be96-4223-8520-605055b3f2b2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:44.794591 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ac5aa306-be96-4223-8520-605055b3f2b2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Going to try to terminate instance {{(pid=117564) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:27:44.882578 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ac5aa306-be96-4223-8520-605055b3f2b2 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 204 len: 0 microversion: 2.1 time: 0.127021 Jun 07 14:27:44.883614 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 324/678] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:27:44 2022] DELETE /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:27:44.895457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7d167d80-5d10-416c-96b6-d1efb86a4093 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:44.896074 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-7d167d80-5d10-416c-96b6-d1efb86a4093 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:44.902516 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7d167d80-5d10-416c-96b6-d1efb86a4093 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:44.902954 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7d167d80-5d10-416c-96b6-d1efb86a4093 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:44.903760 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7d167d80-5d10-416c-96b6-d1efb86a4093 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:44.904195 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7d167d80-5d10-416c-96b6-d1efb86a4093 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:45.049938 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-7d167d80-5d10-416c-96b6-d1efb86a4093 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:45.057561 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-7d167d80-5d10-416c-96b6-d1efb86a4093 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.168134 Jun 07 14:27:45.058130 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 355/679] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:44 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:27:46.076334 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7bbf46ed-7686-4ed0-ac86-2eef668da08d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:46.077039 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7bbf46ed-7686-4ed0-ac86-2eef668da08d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:46.083510 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7bbf46ed-7686-4ed0-ac86-2eef668da08d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:46.083963 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7bbf46ed-7686-4ed0-ac86-2eef668da08d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:46.084756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7bbf46ed-7686-4ed0-ac86-2eef668da08d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:46.085193 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7bbf46ed-7686-4ed0-ac86-2eef668da08d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:46.215486 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-7bbf46ed-7686-4ed0-ac86-2eef668da08d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:46.223526 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7bbf46ed-7686-4ed0-ac86-2eef668da08d tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.152059 Jun 07 14:27:46.224092 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 325/680] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:46 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:47.240445 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-05267fdf-f71e-4b32-94f4-fcd2aa94050c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:47.241065 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-05267fdf-f71e-4b32-94f4-fcd2aa94050c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:47.247429 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-05267fdf-f71e-4b32-94f4-fcd2aa94050c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:47.247881 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-05267fdf-f71e-4b32-94f4-fcd2aa94050c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:47.248648 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-05267fdf-f71e-4b32-94f4-fcd2aa94050c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:47.249085 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-05267fdf-f71e-4b32-94f4-fcd2aa94050c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:47.378610 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-05267fdf-f71e-4b32-94f4-fcd2aa94050c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:47.386023 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-05267fdf-f71e-4b32-94f4-fcd2aa94050c tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1521 microversion: 2.1 time: 0.149482 Jun 07 14:27:47.386586 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 356/681] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:47 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:48.185758 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-201bf14d-7bdf-4490-9eee-c4d075f1a3b6 req-1503af08-a3f7-44c9-92ad-8b191bbea5ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dd5700e-2891-4b99-ba1f-d5304a5c8f58", "name": "network-vif-deleted", "tag": "7d9b7314-f274-43d0-925f-d9b6683e8642"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:27:48.194912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-201bf14d-7bdf-4490-9eee-c4d075f1a3b6 req-1503af08-a3f7-44c9-92ad-8b191bbea5ec service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:48.195398 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-201bf14d-7bdf-4490-9eee-c4d075f1a3b6 req-1503af08-a3f7-44c9-92ad-8b191bbea5ec service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:48.210074 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-201bf14d-7bdf-4490-9eee-c4d075f1a3b6 req-1503af08-a3f7-44c9-92ad-8b191bbea5ec service nova] Creating event network-vif-deleted:7d9b7314-f274-43d0-925f-d9b6683e8642 for instance 4dd5700e-2891-4b99-ba1f-d5304a5c8f58 on hv-cinder-83608 Jun 07 14:27:48.215001 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-201bf14d-7bdf-4490-9eee-c4d075f1a3b6 req-1503af08-a3f7-44c9-92ad-8b191bbea5ec service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032702 Jun 07 14:27:48.216158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 326/682] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:27:48.405032 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-de0a4181-cc72-44d2-a2b8-5ff48a8fc59a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:48.405565 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-de0a4181-cc72-44d2-a2b8-5ff48a8fc59a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:48.411615 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-de0a4181-cc72-44d2-a2b8-5ff48a8fc59a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:48.412080 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-de0a4181-cc72-44d2-a2b8-5ff48a8fc59a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:48.412831 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-de0a4181-cc72-44d2-a2b8-5ff48a8fc59a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:48.413264 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-de0a4181-cc72-44d2-a2b8-5ff48a8fc59a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:48.443177 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-de0a4181-cc72-44d2-a2b8-5ff48a8fc59a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:48.443665 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-de0a4181-cc72-44d2-a2b8-5ff48a8fc59a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:48.444115 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.objects.instance [None req-de0a4181-cc72-44d2-a2b8-5ff48a8fc59a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lazy-loading 'fault' on Instance uuid 4dd5700e-2891-4b99-ba1f-d5304a5c8f58 {{(pid=117565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:27:48.489088 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-de0a4181-cc72-44d2-a2b8-5ff48a8fc59a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20025ab12f4450da20c8e41b931b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8e48464f6a4d1886aaf89cc8b28e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:27:48.497416 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-de0a4181-cc72-44d2-a2b8-5ff48a8fc59a tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 200 len: 1312 microversion: 2.1 time: 0.097029 Jun 07 14:27:48.498016 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 357/683] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:48 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:27:48.824228 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0dfdfa36-6019-4600-938b-5f4f3000f8ef tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:48.824801 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0dfdfa36-6019-4600-938b-5f4f3000f8ef tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:48.831027 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0dfdfa36-6019-4600-938b-5f4f3000f8ef tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:48.831516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0dfdfa36-6019-4600-938b-5f4f3000f8ef tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:48.832279 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0dfdfa36-6019-4600-938b-5f4f3000f8ef tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:48.832716 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0dfdfa36-6019-4600-938b-5f4f3000f8ef tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:48.856855 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0dfdfa36-6019-4600-938b-5f4f3000f8ef tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/ips" status: 200 len: 146 microversion: 2.1 time: 0.036890 Jun 07 14:27:48.857437 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 327/684] 10.222.0.81 () {58 vars in 1247 bytes} [Tue Jun 7 14:27:48 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:27:49.515118 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-39d103f3-ebea-4fea-9bcc-0afadfc5dd39 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:49.515763 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-39d103f3-ebea-4fea-9bcc-0afadfc5dd39 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] [instance: 4dd5700e-2891-4b99-ba1f-d5304a5c8f58] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:49.521700 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-39d103f3-ebea-4fea-9bcc-0afadfc5dd39 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:49.522144 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-39d103f3-ebea-4fea-9bcc-0afadfc5dd39 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:49.522928 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-39d103f3-ebea-4fea-9bcc-0afadfc5dd39 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:49.523398 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-39d103f3-ebea-4fea-9bcc-0afadfc5dd39 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:49.537296 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-39d103f3-ebea-4fea-9bcc-0afadfc5dd39 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] HTTP exception thrown: Instance 4dd5700e-2891-4b99-ba1f-d5304a5c8f58 could not be found. Jun 07 14:27:49.538791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-39d103f3-ebea-4fea-9bcc-0afadfc5dd39 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Request method failure captured: Jun 07 14:27:49.538791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 HTTP/1.1 Jun 07 14:27:49.538791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:27:49.538791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:27:49.538791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:27:49.538791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:27:49.538791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:27:49.538791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:27:49.538791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:27:49.538791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:27:49.538791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin17phWIJ_eQLsN9FOFsHWkCoa6NydW99S4V4yhx6nzXRUhevbmuM6FHueSJUBAhq0lRznadD50RBaf_KCwvLxd5hok2blY9CUWxTTfms_YMLnlhwe8EVLpd2UFPRe-bhvJMSOHgvXQUvrD7rxrLP2RKctJbF_rKq76mqAGT8baB5Tpo Jun 07 14:27:49.538791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:27:49.538791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:27:49.538791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:27:49.538791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:27:49.538791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:27:49.538791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:27:49.538791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: ec8e48464f6a4d1886aaf89cc8b28e5f Jun 07 14:27:49.538791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-444301016 Jun 07 14:27:49.538791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:27:49.538791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:27:49.540437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ec8e48464f6a4d1886aaf89cc8b28e5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ec8e48464f6a4d1886aaf89cc8b28e5f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ec8e48464f6a4d1886aaf89cc8b28e5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ec8e48464f6a4d1886aaf89cc8b28e5f"}]}] Jun 07 14:27:49.540437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-ServerRescueNegativeTestJSON-444301016 Jun 07 14:27:49.540437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: ec8e48464f6a4d1886aaf89cc8b28e5f Jun 07 14:27:49.540437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-444301016 Jun 07 14:27:49.540437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-ServerRescueNegativeTestJSON-444301016-project Jun 07 14:27:49.540437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:27:49.540437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:27:49.540437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: d20025ab12f4450da20c8e41b931b5fc Jun 07 14:27:49.540437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-ServerRescueNegativeTestJSON-444301016-project Jun 07 14:27:49.540437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:27:49.540437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance 4dd5700e-2891-4b99-ba1f-d5304a5c8f58 could not be found. Jun 07 14:27:49.540437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': '4dd5700e-2891-4b99-ba1f-d5304a5c8f58'} Jun 07 14:27:49.541306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:27:49.541306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:27:49.541306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:27:49.541306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:27:49.541306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:27:49.541306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:27:49.541306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:27:49.541306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:27:49.541306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:27:49.541306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:27:49.541306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dd5700e-2891-4b99-ba1f-d5304a5c8f58 could not be found. Jun 07 14:27:49.541306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:27:49.541306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:27:49.541306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:27:49.541306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:27:49.541306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:27:49.541306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:27:49.541306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:27:49.541306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:27:49.541306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:27:49.542671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:27:49.542671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:27:49.542671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:27:49.542671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:27:49.542671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:27:49.542671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:27:49.542671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:27:49.542671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dd5700e-2891-4b99-ba1f-d5304a5c8f58 could not be found. Jun 07 14:27:49.542671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:27:49.542671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:27:49.542671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:27:49.542671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:27:49.542671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:27:49.542671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:27:49.542671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:27:49.542671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:27:49.542671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dd5700e-2891-4b99-ba1f-d5304a5c8f58 could not be found. Jun 07 14:27:49.542671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:27:49.544476 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-39d103f3-ebea-4fea-9bcc-0afadfc5dd39 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] Returning 404 to user: Instance 4dd5700e-2891-4b99-ba1f-d5304a5c8f58 could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:27:49.544476 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-39d103f3-ebea-4fea-9bcc-0afadfc5dd39 tempest-ServerRescueNegativeTestJSON-444301016 tempest-ServerRescueNegativeTestJSON-444301016-project] 10.222.0.81 "GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58" status: 404 len: 111 microversion: 2.1 time: 0.029831 Jun 07 14:27:49.544476 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 358/685] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:27:49 2022] GET /compute/v2.1/servers/4dd5700e-2891-4b99-ba1f-d5304a5c8f58 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:27:49.598492 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a69b80bf-2f9c-404a-ad91-c1088d67880e tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1835077111"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:27:49.599714 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a69b80bf-2f9c-404a-ad91-c1088d67880e tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:49.606920 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a69b80bf-2f9c-404a-ad91-c1088d67880e tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:49.607476 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a69b80bf-2f9c-404a-ad91-c1088d67880e tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:49.608331 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a69b80bf-2f9c-404a-ad91-c1088d67880e tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:49.608839 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a69b80bf-2f9c-404a-ad91-c1088d67880e tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:49.840940 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.network.security_group_api [None req-a69b80bf-2f9c-404a-ad91-c1088d67880e tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Removing security group 260e07c0-80f5-42e0-86b3-50d346f3c11d from port f2581f0d-52d5-4fd2-aac8-ba96fe0f65ed Jun 07 14:27:50.172669 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d989fe16-45af-410c-9cd1-072868fedebc tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4652754-71a0-4966-a084-ffb2c4c97b1f"}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:27:50.173763 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-d989fe16-45af-410c-9cd1-072868fedebc tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:50.180077 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d989fe16-45af-410c-9cd1-072868fedebc tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:50.180806 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d989fe16-45af-410c-9cd1-072868fedebc tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:50.181577 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d989fe16-45af-410c-9cd1-072868fedebc tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:50.182012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d989fe16-45af-410c-9cd1-072868fedebc tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:50.452246 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-d989fe16-45af-410c-9cd1-072868fedebc tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "POST /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285661 Jun 07 14:27:50.453074 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 359/686] 10.222.0.81 () {60 vars in 1322 bytes} [Tue Jun 7 14:27:50 2022] POST /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:27:50.853297 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a69b80bf-2f9c-404a-ad91-c1088d67880e tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "POST /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/action" status: 202 len: 0 microversion: 2.1 time: 1.258607 Jun 07 14:27:50.857431 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 328/687] 10.222.0.81 () {60 vars in 1277 bytes} [Tue Jun 7 14:27:49 2022] POST /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/action => generated 0 bytes in 1264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 14:27:50.862468 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-b0c7ac9b-fcb9-47d9-b988-6f2228dd8aa5 req-7a9557c7-97d5-432d-a98a-355d2fc43b2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad12cd77-70c4-4d1b-a6c3-66ba546ad15a", "tag": "f2581f0d-52d5-4fd2-aac8-ba96fe0f65ed"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:27:50.880535 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-b0c7ac9b-fcb9-47d9-b988-6f2228dd8aa5 req-7a9557c7-97d5-432d-a98a-355d2fc43b2b service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:50.881452 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-b0c7ac9b-fcb9-47d9-b988-6f2228dd8aa5 req-7a9557c7-97d5-432d-a98a-355d2fc43b2b service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:50.899477 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-b0c7ac9b-fcb9-47d9-b988-6f2228dd8aa5 req-7a9557c7-97d5-432d-a98a-355d2fc43b2b service nova] Creating event network-changed:f2581f0d-52d5-4fd2-aac8-ba96fe0f65ed for instance ad12cd77-70c4-4d1b-a6c3-66ba546ad15a on hv-cinder-83608 Jun 07 14:27:50.921096 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-b0c7ac9b-fcb9-47d9-b988-6f2228dd8aa5 req-7a9557c7-97d5-432d-a98a-355d2fc43b2b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064042 Jun 07 14:27:50.923804 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 360/688] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:27:52.031094 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0f30db3f-8687-4ecb-a0f3-c66e7f4ffc01 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:52.031663 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0f30db3f-8687-4ecb-a0f3-c66e7f4ffc01 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:52.035380 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-386c335d-ee8d-4515-b68d-776f85e63dd8 req-009a059d-2c29-4223-8803-8411897d4214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad12cd77-70c4-4d1b-a6c3-66ba546ad15a", "tag": "f2581f0d-52d5-4fd2-aac8-ba96fe0f65ed"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:27:52.044612 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-386c335d-ee8d-4515-b68d-776f85e63dd8 req-009a059d-2c29-4223-8803-8411897d4214 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:52.045360 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-386c335d-ee8d-4515-b68d-776f85e63dd8 req-009a059d-2c29-4223-8803-8411897d4214 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:52.051777 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0f30db3f-8687-4ecb-a0f3-c66e7f4ffc01 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:52.052232 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0f30db3f-8687-4ecb-a0f3-c66e7f4ffc01 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:52.053005 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0f30db3f-8687-4ecb-a0f3-c66e7f4ffc01 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:52.053436 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0f30db3f-8687-4ecb-a0f3-c66e7f4ffc01 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:52.058448 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-386c335d-ee8d-4515-b68d-776f85e63dd8 req-009a059d-2c29-4223-8803-8411897d4214 service nova] Creating event network-changed:f2581f0d-52d5-4fd2-aac8-ba96fe0f65ed for instance ad12cd77-70c4-4d1b-a6c3-66ba546ad15a on hv-cinder-83608 Jun 07 14:27:52.065435 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-386c335d-ee8d-4515-b68d-776f85e63dd8 req-009a059d-2c29-4223-8803-8411897d4214 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034069 Jun 07 14:27:52.066665 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 361/689] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:27:52.145696 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-0f30db3f-8687-4ecb-a0f3-c66e7f4ffc01 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lazy-loading 'services' on Instance uuid ad12cd77-70c4-4d1b-a6c3-66ba546ad15a {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:27:52.149598 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:52.254833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0f30db3f-8687-4ecb-a0f3-c66e7f4ffc01 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/os-volume_attachments/62eaeda1-6250-42e2-bf8b-b1e4bf92b20c" status: 202 len: 0 microversion: 2.1 time: 0.229826 Jun 07 14:27:52.256442 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 329/690] 10.222.0.81 () {58 vars in 1415 bytes} [Tue Jun 7 14:27:52 2022] DELETE /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/os-volume_attachments/62eaeda1-6250-42e2-bf8b-b1e4bf92b20c => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:27:52.274093 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-09ff0f18-dc61-41cd-a2fa-f0f8b8ab50d7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:52.279769 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-09ff0f18-dc61-41cd-a2fa-f0f8b8ab50d7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:52.297759 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-09ff0f18-dc61-41cd-a2fa-f0f8b8ab50d7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:52.300667 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-09ff0f18-dc61-41cd-a2fa-f0f8b8ab50d7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:52.302321 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-09ff0f18-dc61-41cd-a2fa-f0f8b8ab50d7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:52.302987 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-09ff0f18-dc61-41cd-a2fa-f0f8b8ab50d7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:52.338160 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-09ff0f18-dc61-41cd-a2fa-f0f8b8ab50d7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077471 Jun 07 14:27:52.345062 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 362/691] 10.222.0.81 () {58 vars in 1301 bytes} [Tue Jun 7 14:27:52 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:27:53.352817 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8f03a892-40db-405e-8baf-a6d7f7a4bb34 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:53.353895 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8f03a892-40db-405e-8baf-a6d7f7a4bb34 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:53.361332 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8f03a892-40db-405e-8baf-a6d7f7a4bb34 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:53.361786 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8f03a892-40db-405e-8baf-a6d7f7a4bb34 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:53.366381 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8f03a892-40db-405e-8baf-a6d7f7a4bb34 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:53.366982 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8f03a892-40db-405e-8baf-a6d7f7a4bb34 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:53.403415 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8f03a892-40db-405e-8baf-a6d7f7a4bb34 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055263 Jun 07 14:27:53.403991 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 330/692] 10.222.0.81 () {58 vars in 1301 bytes} [Tue Jun 7 14:27:53 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:27:54.415724 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7f733c38-af7e-4b72-911a-ff96639c9a0f tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:54.417774 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-7f733c38-af7e-4b72-911a-ff96639c9a0f tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:54.426291 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7f733c38-af7e-4b72-911a-ff96639c9a0f tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:54.426985 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7f733c38-af7e-4b72-911a-ff96639c9a0f tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:54.427939 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7f733c38-af7e-4b72-911a-ff96639c9a0f tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:54.428523 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7f733c38-af7e-4b72-911a-ff96639c9a0f tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:54.460461 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-7f733c38-af7e-4b72-911a-ff96639c9a0f tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049249 Jun 07 14:27:54.461514 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 363/693] 10.222.0.81 () {58 vars in 1301 bytes} [Tue Jun 7 14:27:54 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:27:55.472349 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ea1dfbe7-2d30-4177-b09c-b36b9d5008c7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:55.473371 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ea1dfbe7-2d30-4177-b09c-b36b9d5008c7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:55.479769 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ea1dfbe7-2d30-4177-b09c-b36b9d5008c7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:55.480360 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ea1dfbe7-2d30-4177-b09c-b36b9d5008c7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:55.481176 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ea1dfbe7-2d30-4177-b09c-b36b9d5008c7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:55.481636 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ea1dfbe7-2d30-4177-b09c-b36b9d5008c7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:55.512534 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ea1dfbe7-2d30-4177-b09c-b36b9d5008c7 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043180 Jun 07 14:27:55.513181 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 331/694] 10.222.0.81 () {58 vars in 1301 bytes} [Tue Jun 7 14:27:55 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:27:56.525498 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-b65d3f99-e9d1-4119-9087-6dfc218cdd1d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:56.526530 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-b65d3f99-e9d1-4119-9087-6dfc218cdd1d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:56.546859 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b65d3f99-e9d1-4119-9087-6dfc218cdd1d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:56.553119 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b65d3f99-e9d1-4119-9087-6dfc218cdd1d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:56.554104 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b65d3f99-e9d1-4119-9087-6dfc218cdd1d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:56.554711 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b65d3f99-e9d1-4119-9087-6dfc218cdd1d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:56.601637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-b65d3f99-e9d1-4119-9087-6dfc218cdd1d tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080518 Jun 07 14:27:56.602341 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 364/695] 10.222.0.81 () {58 vars in 1301 bytes} [Tue Jun 7 14:27:56 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:27:57.613078 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-524f76d4-0605-4687-9a6d-345fbab820cb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:57.613913 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-524f76d4-0605-4687-9a6d-345fbab820cb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:57.620488 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-524f76d4-0605-4687-9a6d-345fbab820cb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:57.621549 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-524f76d4-0605-4687-9a6d-345fbab820cb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:57.622509 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-524f76d4-0605-4687-9a6d-345fbab820cb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:57.622943 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-524f76d4-0605-4687-9a6d-345fbab820cb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:57.652436 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-524f76d4-0605-4687-9a6d-345fbab820cb tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043339 Jun 07 14:27:57.653084 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 332/696] 10.222.0.81 () {58 vars in 1301 bytes} [Tue Jun 7 14:27:57 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:27:58.140129 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-6c1dbc06-a678-410d-8d04-cb0823b77dda tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:58.141814 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-6c1dbc06-a678-410d-8d04-cb0823b77dda tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:58.148617 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6c1dbc06-a678-410d-8d04-cb0823b77dda tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:58.149453 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6c1dbc06-a678-410d-8d04-cb0823b77dda tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:58.150442 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6c1dbc06-a678-410d-8d04-cb0823b77dda tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:58.151137 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6c1dbc06-a678-410d-8d04-cb0823b77dda tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:58.207447 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-6c1dbc06-a678-410d-8d04-cb0823b77dda tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071241 Jun 07 14:27:58.213813 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 365/697] 10.222.0.81 () {58 vars in 1301 bytes} [Tue Jun 7 14:27:58 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:27:58.220011 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ca449e69-5aad-4afe-8be3-b1b5f8e5a82b tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:58.220525 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ca449e69-5aad-4afe-8be3-b1b5f8e5a82b tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:58.227023 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ca449e69-5aad-4afe-8be3-b1b5f8e5a82b tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:58.228092 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ca449e69-5aad-4afe-8be3-b1b5f8e5a82b tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:58.229558 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ca449e69-5aad-4afe-8be3-b1b5f8e5a82b tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:58.230835 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ca449e69-5aad-4afe-8be3-b1b5f8e5a82b tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:58.267897 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ca449e69-5aad-4afe-8be3-b1b5f8e5a82b tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/os-volume_attachments/a4652754-71a0-4966-a084-ffb2c4c97b1f" status: 200 len: 194 microversion: 2.1 time: 0.053763 Jun 07 14:27:58.272407 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 333/698] 10.222.0.81 () {58 vars in 1412 bytes} [Tue Jun 7 14:27:58 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/os-volume_attachments/a4652754-71a0-4966-a084-ffb2c4c97b1f => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:27:58.664098 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-49bae0d0-a0aa-47ee-b6d5-0321fb2a7fe1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:58.665116 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-49bae0d0-a0aa-47ee-b6d5-0321fb2a7fe1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:58.679161 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-49bae0d0-a0aa-47ee-b6d5-0321fb2a7fe1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:58.683138 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-49bae0d0-a0aa-47ee-b6d5-0321fb2a7fe1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:58.685782 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-49bae0d0-a0aa-47ee-b6d5-0321fb2a7fe1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:58.686464 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-49bae0d0-a0aa-47ee-b6d5-0321fb2a7fe1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:58.752851 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-49bae0d0-a0aa-47ee-b6d5-0321fb2a7fe1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085666 Jun 07 14:27:58.752851 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 366/699] 10.222.0.81 () {58 vars in 1301 bytes} [Tue Jun 7 14:27:58 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 14:27:58.759749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-84e20329-50df-4125-ac71-6348ccbdf0d1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:27:58.760318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-84e20329-50df-4125-ac71-6348ccbdf0d1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:58.768541 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-84e20329-50df-4125-ac71-6348ccbdf0d1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:58.768997 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-84e20329-50df-4125-ac71-6348ccbdf0d1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:58.769789 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-84e20329-50df-4125-ac71-6348ccbdf0d1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:58.770416 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-84e20329-50df-4125-ac71-6348ccbdf0d1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:58.864184 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-84e20329-50df-4125-ac71-6348ccbdf0d1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] HTTP exception thrown: Instance ad12cd77-70c4-4d1b-a6c3-66ba546ad15a is not attached to volume 62eaeda1-6250-42e2-bf8b-b1e4bf92b20c Jun 07 14:27:58.868689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-84e20329-50df-4125-ac71-6348ccbdf0d1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Request method failure captured: Jun 07 14:27:58.868689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: request: DELETE /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/os-volume_attachments/62eaeda1-6250-42e2-bf8b-b1e4bf92b20c HTTP/1.1 Jun 07 14:27:58.868689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 07 14:27:58.868689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 07 14:27:58.868689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Connection: close Jun 07 14:27:58.868689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 07 14:27:58.868689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 07 14:27:58.868689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Host: 10.222.0.81 Jun 07 14:27:58.868689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 07 14:27:58.868689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 07 14:27:58.868689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABin1_OhaltvGLaX7FPXRagSpLVv1WZ9AZNBXIrECFpCsXBrSJV7WVZrv64djTBh6ZmYOsz__lGzc1OoHdGf_uokAl7fJmhvopEBt14Gig0vqkI8cP4z6Gx7dF0BFsXwmQmN84k1zjs-l2eyZd99h3-U0FKeY16mXZ_YpJrVWMgRkUPkP4 Jun 07 14:27:58.868689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 07 14:27:58.868689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 07 14:27:58.868689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 07 14:27:58.868689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 07 14:27:58.868689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 07 14:27:58.868689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 07 14:27:58.868689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Id: 1c7b98807cae4a75968ed946de9c92bb Jun 07 14:27:58.868689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-TestMinimumBasicScenario-469415017 Jun 07 14:27:58.868689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Role: member,reader Jun 07 14:27:58.868689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Roles: member,reader Jun 07 14:27:58.870097 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1c7b98807cae4a75968ed946de9c92bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1c7b98807cae4a75968ed946de9c92bb", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1c7b98807cae4a75968ed946de9c92bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1c7b98807cae4a75968ed946de9c92bb"}]}] Jun 07 14:27:58.870097 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-TestMinimumBasicScenario-469415017 Jun 07 14:27:58.870097 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 1c7b98807cae4a75968ed946de9c92bb Jun 07 14:27:58.870097 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-TestMinimumBasicScenario-469415017 Jun 07 14:27:58.870097 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User: tempest-TestMinimumBasicScenario-469415017-project Jun 07 14:27:58.870097 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 07 14:27:58.870097 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 07 14:27:58.870097 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Id: 9bb946aacaf145d5b718f82e28c999d9 Jun 07 14:27:58.870097 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-TestMinimumBasicScenario-469415017-project Jun 07 14:27:58.870097 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: method: > Jun 07 14:27:58.870097 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: exception: Instance ad12cd77-70c4-4d1b-a6c3-66ba546ad15a is not attached to volume 62eaeda1-6250-42e2-bf8b-b1e4bf92b20c Jun 07 14:27:58.870880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: action_args: {'server_id': 'ad12cd77-70c4-4d1b-a6c3-66ba546ad15a', 'id': '62eaeda1-6250-42e2-bf8b-b1e4bf92b20c'} Jun 07 14:27:58.870880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:27:58.870880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:27:58.870880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 07 14:27:58.870880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 07 14:27:58.870880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 14:27:58.870880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 14:27:58.870880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 07 14:27:58.870880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 07 14:27:58.870880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 62eaeda1-6250-42e2-bf8b-b1e4bf92b20c. Jun 07 14:27:58.870880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:27:58.870880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:27:58.870880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:27:58.870880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:27:58.870880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:27:58.870880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:27:58.870880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:27:58.870880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:27:58.870880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:27:58.872211 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:27:58.872211 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 07 14:27:58.872211 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 07 14:27:58.872211 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad12cd77-70c4-4d1b-a6c3-66ba546ad15a is not attached to volume 62eaeda1-6250-42e2-bf8b-b1e4bf92b20c Jun 07 14:27:58.872211 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:27:58.872211 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:27:58.872211 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:27:58.872211 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:27:58.872211 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:27:58.872211 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:27:58.872211 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:27:58.872211 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:27:58.872211 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad12cd77-70c4-4d1b-a6c3-66ba546ad15a is not attached to volume 62eaeda1-6250-42e2-bf8b-b1e4bf92b20c Jun 07 14:27:58.872211 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:27:58.876052 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-84e20329-50df-4125-ac71-6348ccbdf0d1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Returning 404 to user: Instance ad12cd77-70c4-4d1b-a6c3-66ba546ad15a is not attached to volume 62eaeda1-6250-42e2-bf8b-b1e4bf92b20c {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:27:58.877157 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-84e20329-50df-4125-ac71-6348ccbdf0d1 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/os-volume_attachments/62eaeda1-6250-42e2-bf8b-b1e4bf92b20c" status: 404 len: 154 microversion: 2.1 time: 0.123722 Jun 07 14:27:58.878236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 334/700] 10.222.0.81 () {58 vars in 1415 bytes} [Tue Jun 7 14:27:58 2022] DELETE /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a/os-volume_attachments/62eaeda1-6250-42e2-bf8b-b1e4bf92b20c => generated 154 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:27:59.827249 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ab2ae2e0-9bdc-43e2-8281-8a055d2f0173 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cb70346-2abe-4cf1-bdf2-e5eb0930fb43"}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:27:59.831924 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ab2ae2e0-9bdc-43e2-8281-8a055d2f0173 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:27:59.845933 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ab2ae2e0-9bdc-43e2-8281-8a055d2f0173 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:59.847026 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ab2ae2e0-9bdc-43e2-8281-8a055d2f0173 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:27:59.849482 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ab2ae2e0-9bdc-43e2-8281-8a055d2f0173 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:27:59.852465 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ab2ae2e0-9bdc-43e2-8281-8a055d2f0173 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:00.157207 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-05c123a5-b21e-4f4b-a189-a1c168d2c9c5 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Action: 'create', calling method: .version_select at 0x7ff37f4318b0>, body: {"keypair": {"name": "tempest-keypair-1250543104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkCekA25AzoLAQ4IW7fOABo5C58OD0nlLZHQpVBTSyaYjKaqrPCe8qYrU0LEYJwblOLRwe6XHV0T5Wjqzx9QJjP7tbiSDsZz0d5L+wbxV8qEv3Byt1dL+FT7ptgkxgIWQ=="}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:28:00.165246 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:00.175798 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-05c123a5-b21e-4f4b-a189-a1c168d2c9c5 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Getting quotas for project 4c6a6f6bdf7743cba1a36a3e8f67cf02. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:28:00.177533 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ab2ae2e0-9bdc-43e2-8281-8a055d2f0173 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "POST /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.361290 Jun 07 14:28:00.178434 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 367/701] 10.222.0.81 () {60 vars in 1322 bytes} [Tue Jun 7 14:27:59 2022] POST /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/os-volume_attachments => generated 194 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:28:00.185698 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-c6aadd99-662f-4237-8d87-32bbf661cbba tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:00.186297 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-c6aadd99-662f-4237-8d87-32bbf661cbba tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:00.186984 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-05c123a5-b21e-4f4b-a189-a1c168d2c9c5 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Getting quotas for user fefdd9dfa11641a598fcc29b2ad32afc and project 4c6a6f6bdf7743cba1a36a3e8f67cf02. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:28:00.193399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c6aadd99-662f-4237-8d87-32bbf661cbba tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:00.193846 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c6aadd99-662f-4237-8d87-32bbf661cbba tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:00.194791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c6aadd99-662f-4237-8d87-32bbf661cbba tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:00.195419 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c6aadd99-662f-4237-8d87-32bbf661cbba tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:00.221787 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-05c123a5-b21e-4f4b-a189-a1c168d2c9c5 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.214518 Jun 07 14:28:00.223032 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 335/702] 10.222.0.81 () {62 vars in 1199 bytes} [Tue Jun 7 14:28:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 217 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 07 14:28:00.229016 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-c6aadd99-662f-4237-8d87-32bbf661cbba tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Going to try to terminate instance {{(pid=117565) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:28:00.327564 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-c6aadd99-662f-4237-8d87-32bbf661cbba tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 204 len: 0 microversion: 2.1 time: 0.147207 Jun 07 14:28:00.328586 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 368/703] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:28:00 2022] DELETE /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:28:00.336972 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5fd61c4a-1fc1-4e4c-9e3b-fd125ca3f484 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:00.337616 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-5fd61c4a-1fc1-4e4c-9e3b-fd125ca3f484 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:00.345053 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5fd61c4a-1fc1-4e4c-9e3b-fd125ca3f484 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:00.345706 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5fd61c4a-1fc1-4e4c-9e3b-fd125ca3f484 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:00.346685 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5fd61c4a-1fc1-4e4c-9e3b-fd125ca3f484 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:00.347321 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5fd61c4a-1fc1-4e4c-9e3b-fd125ca3f484 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:00.538457 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5fd61c4a-1fc1-4e4c-9e3b-fd125ca3f484 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:00.547618 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-5fd61c4a-1fc1-4e4c-9e3b-fd125ca3f484 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1552 microversion: 2.1 time: 0.214572 Jun 07 14:28:00.548771 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 336/704] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:28:00 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1552 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:28:01.565940 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-0fa697a8-9b53-4fa2-8e7f-a8343aa5c957 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:01.566656 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-0fa697a8-9b53-4fa2-8e7f-a8343aa5c957 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:01.573777 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0fa697a8-9b53-4fa2-8e7f-a8343aa5c957 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:01.574769 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0fa697a8-9b53-4fa2-8e7f-a8343aa5c957 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:01.575585 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0fa697a8-9b53-4fa2-8e7f-a8343aa5c957 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:01.576236 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0fa697a8-9b53-4fa2-8e7f-a8343aa5c957 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:01.722700 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-0fa697a8-9b53-4fa2-8e7f-a8343aa5c957 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:01.730775 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-0fa697a8-9b53-4fa2-8e7f-a8343aa5c957 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1552 microversion: 2.1 time: 0.168759 Jun 07 14:28:01.731550 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 369/705] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:28:01 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1552 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:28:01.913300 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d2548c85-b649-4ee5-8fef-233328a89138 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-504397768", "imageRef": "2864004b-970a-480b-8453-14794f9ccca2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "430b5cee-7acd-49e1-98b5-c069d03f7257"}], "security_groups": [{"name": "tempest-securitygroup--795944233"}], "key_name": "tempest-keypair-1250543104", "user_data": "}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:28:02.020259 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.network.neutron [None req-d2548c85-b649-4ee5-8fef-233328a89138 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] validate_networks() for [('430b5cee-7acd-49e1-98b5-c069d03f7257', None, None, None, None, None)] {{(pid=117564) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:28:02.440020 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-d2548c85-b649-4ee5-8fef-233328a89138 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Flavor limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:28:02.440464 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-d2548c85-b649-4ee5-8fef-233328a89138 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Image limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:28:02.440951 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-d2548c85-b649-4ee5-8fef-233328a89138 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Flavor pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:28:02.441370 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-d2548c85-b649-4ee5-8fef-233328a89138 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Image pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:28:02.441794 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-d2548c85-b649-4ee5-8fef-233328a89138 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:28:02.455733 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d2548c85-b649-4ee5-8fef-233328a89138 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:02.456194 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d2548c85-b649-4ee5-8fef-233328a89138 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:02.457004 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d2548c85-b649-4ee5-8fef-233328a89138 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:02.457601 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d2548c85-b649-4ee5-8fef-233328a89138 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:02.475121 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-d2548c85-b649-4ee5-8fef-233328a89138 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Getting quotas for project 4c6a6f6bdf7743cba1a36a3e8f67cf02. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:28:02.479211 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-d2548c85-b649-4ee5-8fef-233328a89138 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Getting quotas for user fefdd9dfa11641a598fcc29b2ad32afc and project 4c6a6f6bdf7743cba1a36a3e8f67cf02. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:28:02.490375 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d2548c85-b649-4ee5-8fef-233328a89138 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Going to run 1 instances... {{(pid=117564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:28:02.492700 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d2548c85-b649-4ee5-8fef-233328a89138 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2864004b-970a-480b-8453-14794f9ccca2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:28:02.546389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d2548c85-b649-4ee5-8fef-233328a89138 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.637405 Jun 07 14:28:02.547664 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 337/706] 10.222.0.81 () {62 vars in 1187 bytes} [Tue Jun 7 14:28:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 07 14:28:02.557612 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-8d73239d-5486-4890-821d-44ca714adb99 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:02.558765 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-8d73239d-5486-4890-821d-44ca714adb99 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:02.632270 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8d73239d-5486-4890-821d-44ca714adb99 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:02.640446 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8d73239d-5486-4890-821d-44ca714adb99 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:02.642201 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8d73239d-5486-4890-821d-44ca714adb99 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:02.643619 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-8d73239d-5486-4890-821d-44ca714adb99 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1281 microversion: 2.20 time: 0.090204 Jun 07 14:28:02.644692 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 370/707] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:28:02 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1281 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:28:02.750303 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2411ff78-43d8-4668-b1f6-5a364f4a6f2c tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:02.751503 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2411ff78-43d8-4668-b1f6-5a364f4a6f2c tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:02.758054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2411ff78-43d8-4668-b1f6-5a364f4a6f2c tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:02.758629 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2411ff78-43d8-4668-b1f6-5a364f4a6f2c tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:02.759544 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2411ff78-43d8-4668-b1f6-5a364f4a6f2c tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:02.760202 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2411ff78-43d8-4668-b1f6-5a364f4a6f2c tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:03.099866 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2411ff78-43d8-4668-b1f6-5a364f4a6f2c tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:03.110232 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2411ff78-43d8-4668-b1f6-5a364f4a6f2c tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1552 microversion: 2.1 time: 0.365871 Jun 07 14:28:03.111804 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 338/708] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:28:02 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1552 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:28:03.337834 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-04ee9885-93f2-4828-9714-39261b39a46f req-886e41b6-3014-474a-b773-3338391f755e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad12cd77-70c4-4d1b-a6c3-66ba546ad15a", "name": "network-vif-deleted", "tag": "f2581f0d-52d5-4fd2-aac8-ba96fe0f65ed"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:28:03.357631 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-04ee9885-93f2-4828-9714-39261b39a46f req-886e41b6-3014-474a-b773-3338391f755e service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:03.358067 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-04ee9885-93f2-4828-9714-39261b39a46f req-886e41b6-3014-474a-b773-3338391f755e service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:03.382642 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-04ee9885-93f2-4828-9714-39261b39a46f req-886e41b6-3014-474a-b773-3338391f755e service nova] Creating event network-vif-deleted:f2581f0d-52d5-4fd2-aac8-ba96fe0f65ed for instance ad12cd77-70c4-4d1b-a6c3-66ba546ad15a on hv-cinder-83608 Jun 07 14:28:03.388232 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-04ee9885-93f2-4828-9714-39261b39a46f req-886e41b6-3014-474a-b773-3338391f755e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054090 Jun 07 14:28:03.389039 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 371/709] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:28:03.661998 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-df79dcee-cdb4-4eed-bdcb-8d0a9c585e04 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:03.663092 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-df79dcee-cdb4-4eed-bdcb-8d0a9c585e04 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:03.670883 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-df79dcee-cdb4-4eed-bdcb-8d0a9c585e04 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:03.671368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-df79dcee-cdb4-4eed-bdcb-8d0a9c585e04 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:03.672152 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-df79dcee-cdb4-4eed-bdcb-8d0a9c585e04 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:03.672922 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-df79dcee-cdb4-4eed-bdcb-8d0a9c585e04 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:03.754718 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-df79dcee-cdb4-4eed-bdcb-8d0a9c585e04 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:03.764753 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-df79dcee-cdb4-4eed-bdcb-8d0a9c585e04 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:03.767629 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-df79dcee-cdb4-4eed-bdcb-8d0a9c585e04 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:03.768977 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-df79dcee-cdb4-4eed-bdcb-8d0a9c585e04 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1333 microversion: 2.20 time: 0.110861 Jun 07 14:28:03.769622 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 339/710] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:28:03 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1333 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:28:04.129345 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-6d05f971-f9b0-4069-920d-a91a9ef436f3 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:04.130076 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-6d05f971-f9b0-4069-920d-a91a9ef436f3 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:04.138067 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6d05f971-f9b0-4069-920d-a91a9ef436f3 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:04.138646 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6d05f971-f9b0-4069-920d-a91a9ef436f3 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:04.139735 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6d05f971-f9b0-4069-920d-a91a9ef436f3 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:04.140258 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6d05f971-f9b0-4069-920d-a91a9ef436f3 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:04.175863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6d05f971-f9b0-4069-920d-a91a9ef436f3 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:04.176234 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6d05f971-f9b0-4069-920d-a91a9ef436f3 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:04.176939 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.objects.instance [None req-6d05f971-f9b0-4069-920d-a91a9ef436f3 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lazy-loading 'fault' on Instance uuid ad12cd77-70c4-4d1b-a6c3-66ba546ad15a {{(pid=117565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:28:04.232702 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-6d05f971-f9b0-4069-920d-a91a9ef436f3 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb946aacaf145d5b718f82e28c999d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7b98807cae4a75968ed946de9c92bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:04.244306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-6d05f971-f9b0-4069-920d-a91a9ef436f3 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 200 len: 1346 microversion: 2.1 time: 0.119087 Jun 07 14:28:04.245615 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 372/711] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:28:04 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 1346 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:28:04.787708 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5067bd61-6f5d-4437-8d0f-3edcf27d3511 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:04.788303 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-5067bd61-6f5d-4437-8d0f-3edcf27d3511 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:04.794994 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5067bd61-6f5d-4437-8d0f-3edcf27d3511 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:04.795480 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5067bd61-6f5d-4437-8d0f-3edcf27d3511 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:04.796255 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5067bd61-6f5d-4437-8d0f-3edcf27d3511 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:04.796691 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5067bd61-6f5d-4437-8d0f-3edcf27d3511 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:04.878214 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5067bd61-6f5d-4437-8d0f-3edcf27d3511 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:04.887155 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5067bd61-6f5d-4437-8d0f-3edcf27d3511 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:04.888785 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5067bd61-6f5d-4437-8d0f-3edcf27d3511 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:04.889911 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-5067bd61-6f5d-4437-8d0f-3edcf27d3511 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1339 microversion: 2.20 time: 0.106120 Jun 07 14:28:04.890679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 340/712] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:28:04 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1339 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:28:05.261802 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3a996af3-0e54-47cc-b4fa-9d10580481a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:05.262422 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-3a996af3-0e54-47cc-b4fa-9d10580481a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] [instance: ad12cd77-70c4-4d1b-a6c3-66ba546ad15a] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:05.265901 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:05.269859 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3a996af3-0e54-47cc-b4fa-9d10580481a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:05.270309 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3a996af3-0e54-47cc-b4fa-9d10580481a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:05.271075 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3a996af3-0e54-47cc-b4fa-9d10580481a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:05.271539 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3a996af3-0e54-47cc-b4fa-9d10580481a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:05.289047 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-3a996af3-0e54-47cc-b4fa-9d10580481a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] HTTP exception thrown: Instance ad12cd77-70c4-4d1b-a6c3-66ba546ad15a could not be found. Jun 07 14:28:05.290694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3a996af3-0e54-47cc-b4fa-9d10580481a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Request method failure captured: Jun 07 14:28:05.290694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a HTTP/1.1 Jun 07 14:28:05.290694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:28:05.290694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:28:05.290694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:28:05.290694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:28:05.290694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:28:05.290694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:28:05.290694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:28:05.290694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:28:05.290694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin1_OhaltvGLaX7FPXRagSpLVv1WZ9AZNBXIrECFpCsXBrSJV7WVZrv64djTBh6ZmYOsz__lGzc1OoHdGf_uokAl7fJmhvopEBt14Gig0vqkI8cP4z6Gx7dF0BFsXwmQmN84k1zjs-l2eyZd99h3-U0FKeY16mXZ_YpJrVWMgRkUPkP4 Jun 07 14:28:05.290694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:28:05.290694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:28:05.290694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:28:05.290694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:28:05.290694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:28:05.290694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:28:05.290694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: 1c7b98807cae4a75968ed946de9c92bb Jun 07 14:28:05.290694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-TestMinimumBasicScenario-469415017 Jun 07 14:28:05.290694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:28:05.290694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:28:05.292307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1c7b98807cae4a75968ed946de9c92bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1c7b98807cae4a75968ed946de9c92bb", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1c7b98807cae4a75968ed946de9c92bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1c7b98807cae4a75968ed946de9c92bb"}]}] Jun 07 14:28:05.292307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-TestMinimumBasicScenario-469415017 Jun 07 14:28:05.292307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: 1c7b98807cae4a75968ed946de9c92bb Jun 07 14:28:05.292307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-TestMinimumBasicScenario-469415017 Jun 07 14:28:05.292307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-TestMinimumBasicScenario-469415017-project Jun 07 14:28:05.292307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:28:05.292307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:28:05.292307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: 9bb946aacaf145d5b718f82e28c999d9 Jun 07 14:28:05.292307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-TestMinimumBasicScenario-469415017-project Jun 07 14:28:05.292307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:28:05.292307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance ad12cd77-70c4-4d1b-a6c3-66ba546ad15a could not be found. Jun 07 14:28:05.292307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': 'ad12cd77-70c4-4d1b-a6c3-66ba546ad15a'} Jun 07 14:28:05.293820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:28:05.293820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:28:05.293820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:28:05.293820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:28:05.293820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:28:05.293820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:28:05.293820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:28:05.293820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:28:05.293820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:28:05.293820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:28:05.293820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad12cd77-70c4-4d1b-a6c3-66ba546ad15a could not be found. Jun 07 14:28:05.293820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:28:05.293820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:28:05.293820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:28:05.293820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:28:05.293820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:28:05.293820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:28:05.293820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:28:05.293820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:28:05.293820 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:28:05.298701 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:28:05.298701 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:28:05.298701 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:28:05.298701 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:28:05.298701 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:28:05.298701 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:28:05.298701 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:28:05.298701 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad12cd77-70c4-4d1b-a6c3-66ba546ad15a could not be found. Jun 07 14:28:05.298701 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:28:05.298701 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:28:05.298701 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:28:05.298701 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:28:05.298701 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:28:05.298701 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:28:05.298701 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:28:05.298701 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:28:05.298701 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad12cd77-70c4-4d1b-a6c3-66ba546ad15a could not be found. Jun 07 14:28:05.298701 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:28:05.300046 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3a996af3-0e54-47cc-b4fa-9d10580481a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Returning 404 to user: Instance ad12cd77-70c4-4d1b-a6c3-66ba546ad15a could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:28:05.300046 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-3a996af3-0e54-47cc-b4fa-9d10580481a9 tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a" status: 404 len: 111 microversion: 2.1 time: 0.034927 Jun 07 14:28:05.300046 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 373/713] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:28:05 2022] GET /compute/v2.1/servers/ad12cd77-70c4-4d1b-a6c3-66ba546ad15a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:28:05.309039 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-95ac44ef-c514-4820-a82d-633c1c60d0ec tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] Calling method '.version_select at 0x7ff37f3f2790>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:05.326801 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-95ac44ef-c514-4820-a82d-633c1c60d0ec tempest-TestMinimumBasicScenario-469415017 tempest-TestMinimumBasicScenario-469415017-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-20677943" status: 202 len: 0 microversion: 2.1 time: 0.025496 Jun 07 14:28:05.327417 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 341/714] 10.222.0.81 () {58 vars in 1265 bytes} [Tue Jun 7 14:28:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-20677943 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:28:05.758498 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-74246bd3-8859-4af7-9081-86a0ec13b119 req-4b6d1e95-1425-4e79-a2c2-4c8edbf5c739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2ed6c33-30a8-4a3b-aba5-57610c2ec718", "tag": "3f5b3dca-4f2b-407e-9796-9a5c5a344abb"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:28:05.772183 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-74246bd3-8859-4af7-9081-86a0ec13b119 req-4b6d1e95-1425-4e79-a2c2-4c8edbf5c739 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:05.773458 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-74246bd3-8859-4af7-9081-86a0ec13b119 req-4b6d1e95-1425-4e79-a2c2-4c8edbf5c739 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:05.789514 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-74246bd3-8859-4af7-9081-86a0ec13b119 req-4b6d1e95-1425-4e79-a2c2-4c8edbf5c739 service nova] Creating event network-changed:3f5b3dca-4f2b-407e-9796-9a5c5a344abb for instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718 on hv-cinder-83608 Jun 07 14:28:05.796058 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-74246bd3-8859-4af7-9081-86a0ec13b119 req-4b6d1e95-1425-4e79-a2c2-4c8edbf5c739 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054469 Jun 07 14:28:05.797036 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 374/715] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:28:05.915064 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5d01c6d6-66c2-4d70-bd74-d7ff7e94158a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:05.916383 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-5d01c6d6-66c2-4d70-bd74-d7ff7e94158a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:05.924964 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5d01c6d6-66c2-4d70-bd74-d7ff7e94158a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:05.925754 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5d01c6d6-66c2-4d70-bd74-d7ff7e94158a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:05.926778 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5d01c6d6-66c2-4d70-bd74-d7ff7e94158a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:05.927461 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5d01c6d6-66c2-4d70-bd74-d7ff7e94158a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:06.157479 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5d01c6d6-66c2-4d70-bd74-d7ff7e94158a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:06.168830 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5d01c6d6-66c2-4d70-bd74-d7ff7e94158a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:06.169081 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5d01c6d6-66c2-4d70-bd74-d7ff7e94158a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:06.170288 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-5d01c6d6-66c2-4d70-bd74-d7ff7e94158a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1406 microversion: 2.20 time: 0.264974 Jun 07 14:28:06.170931 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 342/716] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:28:05 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:28:07.189850 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-2c5fd260-ddcc-40b8-bbfc-32f9bb5c4804 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:07.190548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-2c5fd260-ddcc-40b8-bbfc-32f9bb5c4804 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:07.196702 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2c5fd260-ddcc-40b8-bbfc-32f9bb5c4804 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:07.197153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2c5fd260-ddcc-40b8-bbfc-32f9bb5c4804 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:07.197904 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2c5fd260-ddcc-40b8-bbfc-32f9bb5c4804 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:07.199109 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2c5fd260-ddcc-40b8-bbfc-32f9bb5c4804 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:07.632389 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-2c5fd260-ddcc-40b8-bbfc-32f9bb5c4804 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:07.641552 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-2c5fd260-ddcc-40b8-bbfc-32f9bb5c4804 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:07.643370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-2c5fd260-ddcc-40b8-bbfc-32f9bb5c4804 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:07.644573 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-2c5fd260-ddcc-40b8-bbfc-32f9bb5c4804 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1406 microversion: 2.20 time: 0.459562 Jun 07 14:28:07.656091 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 375/717] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:28:07 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1406 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:28:08.662982 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1316d268-d582-4303-bda8-7ff8ef48a9f3 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:08.663757 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1316d268-d582-4303-bda8-7ff8ef48a9f3 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:08.669183 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:08.682555 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1316d268-d582-4303-bda8-7ff8ef48a9f3 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:08.683431 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1316d268-d582-4303-bda8-7ff8ef48a9f3 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:08.686666 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1316d268-d582-4303-bda8-7ff8ef48a9f3 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:08.687265 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1316d268-d582-4303-bda8-7ff8ef48a9f3 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:08.930996 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-0218c299-e91a-433d-83bd-8bf0dc72ced5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:08.933895 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-0218c299-e91a-433d-83bd-8bf0dc72ced5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:08.943746 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0218c299-e91a-433d-83bd-8bf0dc72ced5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:08.953420 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0218c299-e91a-433d-83bd-8bf0dc72ced5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:08.956344 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0218c299-e91a-433d-83bd-8bf0dc72ced5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:08.957028 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0218c299-e91a-433d-83bd-8bf0dc72ced5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:09.017011 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-0218c299-e91a-433d-83bd-8bf0dc72ced5 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.093883 Jun 07 14:28:09.018714 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 376/718] 10.222.0.81 () {58 vars in 1301 bytes} [Tue Jun 7 14:28:08 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/os-volume_attachments => generated 371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:28:09.070925 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1316d268-d582-4303-bda8-7ff8ef48a9f3 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:09.079558 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1316d268-d582-4303-bda8-7ff8ef48a9f3 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:09.081426 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1316d268-d582-4303-bda8-7ff8ef48a9f3 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:09.082776 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1316d268-d582-4303-bda8-7ff8ef48a9f3 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1406 microversion: 2.20 time: 0.424160 Jun 07 14:28:09.092036 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 343/719] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:28:08 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1406 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:28:09.167651 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-671e6273-9b61-46c9-9d8a-6f231f3b0452 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:09.168166 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-671e6273-9b61-46c9-9d8a-6f231f3b0452 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:09.174516 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-671e6273-9b61-46c9-9d8a-6f231f3b0452 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:09.174973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-671e6273-9b61-46c9-9d8a-6f231f3b0452 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:09.175785 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-671e6273-9b61-46c9-9d8a-6f231f3b0452 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:09.176223 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-671e6273-9b61-46c9-9d8a-6f231f3b0452 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:09.206911 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-671e6273-9b61-46c9-9d8a-6f231f3b0452 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/os-volume_attachments/a4652754-71a0-4966-a084-ffb2c4c97b1f" status: 200 len: 194 microversion: 2.1 time: 0.043331 Jun 07 14:28:09.207451 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 377/720] 10.222.0.81 () {58 vars in 1412 bytes} [Tue Jun 7 14:28:09 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/os-volume_attachments/a4652754-71a0-4966-a084-ffb2c4c97b1f => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:28:09.218446 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-20cde7f5-62de-4a4e-a5e1-f22df2ed8efe tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:09.219038 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-20cde7f5-62de-4a4e-a5e1-f22df2ed8efe tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:09.225183 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-20cde7f5-62de-4a4e-a5e1-f22df2ed8efe tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:09.225710 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-20cde7f5-62de-4a4e-a5e1-f22df2ed8efe tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:09.226553 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-20cde7f5-62de-4a4e-a5e1-f22df2ed8efe tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:09.227086 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-20cde7f5-62de-4a4e-a5e1-f22df2ed8efe tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:09.312614 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-20cde7f5-62de-4a4e-a5e1-f22df2ed8efe tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lazy-loading 'services' on Instance uuid e8660c0c-0d13-43ac-8023-08fa4f47a54b {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:28:09.386523 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-20cde7f5-62de-4a4e-a5e1-f22df2ed8efe tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/os-volume_attachments/a4652754-71a0-4966-a084-ffb2c4c97b1f" status: 202 len: 0 microversion: 2.1 time: 0.172499 Jun 07 14:28:09.387719 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 344/721] 10.222.0.81 () {58 vars in 1415 bytes} [Tue Jun 7 14:28:09 2022] DELETE /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/os-volume_attachments/a4652754-71a0-4966-a084-ffb2c4c97b1f => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:28:10.107526 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-54a297e5-47ea-482c-9074-9ded7d9304c9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:10.108246 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-54a297e5-47ea-482c-9074-9ded7d9304c9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:10.115803 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-54a297e5-47ea-482c-9074-9ded7d9304c9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:10.116486 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-54a297e5-47ea-482c-9074-9ded7d9304c9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:10.117296 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-54a297e5-47ea-482c-9074-9ded7d9304c9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:10.117734 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-54a297e5-47ea-482c-9074-9ded7d9304c9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:10.328530 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-54a297e5-47ea-482c-9074-9ded7d9304c9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:10.337928 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-54a297e5-47ea-482c-9074-9ded7d9304c9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:10.340791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-54a297e5-47ea-482c-9074-9ded7d9304c9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:10.342195 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-54a297e5-47ea-482c-9074-9ded7d9304c9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1406 microversion: 2.20 time: 0.240088 Jun 07 14:28:10.342758 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 378/722] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:28:10 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:28:11.362156 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3986539b-5ca9-442e-93d8-a74def904577 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:11.362840 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3986539b-5ca9-442e-93d8-a74def904577 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:11.371651 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3986539b-5ca9-442e-93d8-a74def904577 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:11.372100 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3986539b-5ca9-442e-93d8-a74def904577 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:11.372868 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3986539b-5ca9-442e-93d8-a74def904577 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:11.373305 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3986539b-5ca9-442e-93d8-a74def904577 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:11.591281 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-719bf376-8d15-4b0a-b657-ffb62d2163dd tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:11.592086 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-719bf376-8d15-4b0a-b657-ffb62d2163dd tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:11.598484 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-719bf376-8d15-4b0a-b657-ffb62d2163dd tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:11.598930 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-719bf376-8d15-4b0a-b657-ffb62d2163dd tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:11.599717 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-719bf376-8d15-4b0a-b657-ffb62d2163dd tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:11.600152 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-719bf376-8d15-4b0a-b657-ffb62d2163dd tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:11.612200 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3986539b-5ca9-442e-93d8-a74def904577 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:11.620986 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3986539b-5ca9-442e-93d8-a74def904577 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:11.623038 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3986539b-5ca9-442e-93d8-a74def904577 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:11.624499 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3986539b-5ca9-442e-93d8-a74def904577 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1406 microversion: 2.20 time: 0.266996 Jun 07 14:28:11.625064 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 345/723] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:28:11 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:28:11.635020 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-719bf376-8d15-4b0a-b657-ffb62d2163dd tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/os-volume_attachments/9cb70346-2abe-4cf1-bdf2-e5eb0930fb43" status: 200 len: 194 microversion: 2.1 time: 0.047968 Jun 07 14:28:11.635642 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 379/724] 10.222.0.81 () {58 vars in 1412 bytes} [Tue Jun 7 14:28:11 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/os-volume_attachments/9cb70346-2abe-4cf1-bdf2-e5eb0930fb43 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:28:11.647002 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3dd6f04f-2c68-45d8-9055-c562a3047e74 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:11.647659 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3dd6f04f-2c68-45d8-9055-c562a3047e74 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:11.654732 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3dd6f04f-2c68-45d8-9055-c562a3047e74 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:11.655290 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3dd6f04f-2c68-45d8-9055-c562a3047e74 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:11.656132 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3dd6f04f-2c68-45d8-9055-c562a3047e74 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:11.656641 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3dd6f04f-2c68-45d8-9055-c562a3047e74 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:11.737814 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-3dd6f04f-2c68-45d8-9055-c562a3047e74 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lazy-loading 'services' on Instance uuid e8660c0c-0d13-43ac-8023-08fa4f47a54b {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:28:11.828795 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3dd6f04f-2c68-45d8-9055-c562a3047e74 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/os-volume_attachments/9cb70346-2abe-4cf1-bdf2-e5eb0930fb43" status: 202 len: 0 microversion: 2.1 time: 0.185410 Jun 07 14:28:11.829398 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 346/725] 10.222.0.81 () {58 vars in 1415 bytes} [Tue Jun 7 14:28:11 2022] DELETE /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/os-volume_attachments/9cb70346-2abe-4cf1-bdf2-e5eb0930fb43 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:28:12.392725 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-e159430f-128f-4415-9306-dbcda0af6928 req-6991325a-bcee-423a-b134-c519f792c1aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ed6c33-30a8-4a3b-aba5-57610c2ec718", "name": "network-vif-plugged", "status": "completed", "tag": "3f5b3dca-4f2b-407e-9796-9a5c5a344abb"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:28:12.405340 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-e159430f-128f-4415-9306-dbcda0af6928 req-6991325a-bcee-423a-b134-c519f792c1aa service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:12.405973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-e159430f-128f-4415-9306-dbcda0af6928 req-6991325a-bcee-423a-b134-c519f792c1aa service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:12.419896 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-e159430f-128f-4415-9306-dbcda0af6928 req-6991325a-bcee-423a-b134-c519f792c1aa service nova] Creating event network-vif-plugged:3f5b3dca-4f2b-407e-9796-9a5c5a344abb for instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718 on hv-cinder-83608 Jun 07 14:28:12.425064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-e159430f-128f-4415-9306-dbcda0af6928 req-6991325a-bcee-423a-b134-c519f792c1aa service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036707 Jun 07 14:28:12.425666 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 380/726] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:28:12.640816 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:12.642438 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=10 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:12.652206 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a92ccb9c-e5e4-465b-af27-3d94e8ab7629 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:12.659722 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a92ccb9c-e5e4-465b-af27-3d94e8ab7629 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:12.675833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a92ccb9c-e5e4-465b-af27-3d94e8ab7629 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:12.676550 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a92ccb9c-e5e4-465b-af27-3d94e8ab7629 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:12.678427 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a92ccb9c-e5e4-465b-af27-3d94e8ab7629 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:12.679107 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a92ccb9c-e5e4-465b-af27-3d94e8ab7629 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:12.712912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=3 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:12.977393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a92ccb9c-e5e4-465b-af27-3d94e8ab7629 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:12.988119 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a92ccb9c-e5e4-465b-af27-3d94e8ab7629 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:12.994564 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a92ccb9c-e5e4-465b-af27-3d94e8ab7629 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:12.996239 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a92ccb9c-e5e4-465b-af27-3d94e8ab7629 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1406 microversion: 2.20 time: 0.356757 Jun 07 14:28:12.997239 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 347/727] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:28:12 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1406 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:28:13.045516 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=2 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:13.050206 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-6866384a-27eb-48e3-bd02-53b55bb64596 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:13.051328 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-6866384a-27eb-48e3-bd02-53b55bb64596 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:13.057898 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6866384a-27eb-48e3-bd02-53b55bb64596 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:13.058669 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6866384a-27eb-48e3-bd02-53b55bb64596 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:13.059585 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6866384a-27eb-48e3-bd02-53b55bb64596 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:13.060034 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6866384a-27eb-48e3-bd02-53b55bb64596 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:13.096793 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-6866384a-27eb-48e3-bd02-53b55bb64596 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052518 Jun 07 14:28:13.099323 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 381/728] 10.222.0.81 () {58 vars in 1301 bytes} [Tue Jun 7 14:28:13 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 14:28:13.214686 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3adae153-8da2-433d-b77b-abf45152e024 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:13.216033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3adae153-8da2-433d-b77b-abf45152e024 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:13.223582 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3adae153-8da2-433d-b77b-abf45152e024 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:13.224897 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3adae153-8da2-433d-b77b-abf45152e024 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:13.226053 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3adae153-8da2-433d-b77b-abf45152e024 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:13.227095 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3adae153-8da2-433d-b77b-abf45152e024 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:13.259618 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3adae153-8da2-433d-b77b-abf45152e024 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049432 Jun 07 14:28:13.260290 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 348/729] 10.222.0.81 () {58 vars in 1301 bytes} [Tue Jun 7 14:28:13 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 14:28:13.321728 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-73bfbb4f-57f6-4206-82e4-b1a02dda1f78 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:13.322236 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-73bfbb4f-57f6-4206-82e4-b1a02dda1f78 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:13.328444 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-73bfbb4f-57f6-4206-82e4-b1a02dda1f78 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:13.328908 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-73bfbb4f-57f6-4206-82e4-b1a02dda1f78 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:13.329663 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-73bfbb4f-57f6-4206-82e4-b1a02dda1f78 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:13.330102 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-73bfbb4f-57f6-4206-82e4-b1a02dda1f78 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:13.359080 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-73bfbb4f-57f6-4206-82e4-b1a02dda1f78 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Going to try to terminate instance {{(pid=117565) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:28:13.601473 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-73bfbb4f-57f6-4206-82e4-b1a02dda1f78 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b" status: 204 len: 0 microversion: 2.1 time: 0.283290 Jun 07 14:28:13.602064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 382/730] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:28:13 2022] DELETE /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:28:13.610235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-91449d76-6b24-4fe7-bcf9-b63f4f1ff85f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:13.610991 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-91449d76-6b24-4fe7-bcf9-b63f4f1ff85f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:13.617174 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-91449d76-6b24-4fe7-bcf9-b63f4f1ff85f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:13.617698 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-91449d76-6b24-4fe7-bcf9-b63f4f1ff85f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:13.618527 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-91449d76-6b24-4fe7-bcf9-b63f4f1ff85f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:13.619035 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-91449d76-6b24-4fe7-bcf9-b63f4f1ff85f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:13.755253 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-91449d76-6b24-4fe7-bcf9-b63f4f1ff85f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:13.763575 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-91449d76-6b24-4fe7-bcf9-b63f4f1ff85f tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b" status: 200 len: 1674 microversion: 2.1 time: 0.157059 Jun 07 14:28:13.764304 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 349/731] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:28:13 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:28:14.016672 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-2723661f-cb73-4c03-a3be-e02fe15f2de7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:14.017365 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-2723661f-cb73-4c03-a3be-e02fe15f2de7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:14.026740 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2723661f-cb73-4c03-a3be-e02fe15f2de7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:14.027283 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2723661f-cb73-4c03-a3be-e02fe15f2de7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:14.028052 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2723661f-cb73-4c03-a3be-e02fe15f2de7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:14.028483 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2723661f-cb73-4c03-a3be-e02fe15f2de7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:14.183140 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-2723661f-cb73-4c03-a3be-e02fe15f2de7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:14.191331 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-2723661f-cb73-4c03-a3be-e02fe15f2de7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:14.192855 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-2723661f-cb73-4c03-a3be-e02fe15f2de7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:14.193965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-2723661f-cb73-4c03-a3be-e02fe15f2de7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1406 microversion: 2.20 time: 0.181531 Jun 07 14:28:14.194537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 383/732] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:28:14 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:28:14.780669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ff0271ad-5868-4b05-96a3-933731527af9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:14.781192 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ff0271ad-5868-4b05-96a3-933731527af9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:14.787691 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ff0271ad-5868-4b05-96a3-933731527af9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:14.788141 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ff0271ad-5868-4b05-96a3-933731527af9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:14.788902 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ff0271ad-5868-4b05-96a3-933731527af9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:14.789370 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ff0271ad-5868-4b05-96a3-933731527af9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:14.920431 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ff0271ad-5868-4b05-96a3-933731527af9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:14.927989 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ff0271ad-5868-4b05-96a3-933731527af9 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b" status: 200 len: 1674 microversion: 2.1 time: 0.151251 Jun 07 14:28:14.928557 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 350/733] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:28:14 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:28:15.212126 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7d4161a1-c2cb-413a-8c64-79edd569167b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:15.212739 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-7d4161a1-c2cb-413a-8c64-79edd569167b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:15.219546 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7d4161a1-c2cb-413a-8c64-79edd569167b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:15.219998 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7d4161a1-c2cb-413a-8c64-79edd569167b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:15.220788 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7d4161a1-c2cb-413a-8c64-79edd569167b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:15.221222 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7d4161a1-c2cb-413a-8c64-79edd569167b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:15.239517 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:15.349884 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-7d4161a1-c2cb-413a-8c64-79edd569167b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:15.358419 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-7d4161a1-c2cb-413a-8c64-79edd569167b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:15.359977 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-7d4161a1-c2cb-413a-8c64-79edd569167b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:15.361073 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-7d4161a1-c2cb-413a-8c64-79edd569167b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1406 microversion: 2.20 time: 0.152871 Jun 07 14:28:15.361625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 384/734] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:28:15 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:28:15.945496 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9e2bc34f-9373-4bf1-b0e8-f23a57648d62 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:15.946108 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9e2bc34f-9373-4bf1-b0e8-f23a57648d62 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:15.952865 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9e2bc34f-9373-4bf1-b0e8-f23a57648d62 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:15.953316 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9e2bc34f-9373-4bf1-b0e8-f23a57648d62 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:15.954075 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9e2bc34f-9373-4bf1-b0e8-f23a57648d62 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:15.954511 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9e2bc34f-9373-4bf1-b0e8-f23a57648d62 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:16.087805 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9e2bc34f-9373-4bf1-b0e8-f23a57648d62 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:16.095692 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9e2bc34f-9373-4bf1-b0e8-f23a57648d62 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b" status: 200 len: 1674 microversion: 2.1 time: 0.154028 Jun 07 14:28:16.096263 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 351/735] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:28:15 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:28:16.379927 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-6656012e-be1a-488c-84a8-7edcebcb4c4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:16.380536 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-6656012e-be1a-488c-84a8-7edcebcb4c4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:16.387878 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6656012e-be1a-488c-84a8-7edcebcb4c4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:16.388353 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6656012e-be1a-488c-84a8-7edcebcb4c4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:16.389108 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6656012e-be1a-488c-84a8-7edcebcb4c4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:16.389540 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6656012e-be1a-488c-84a8-7edcebcb4c4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:16.523877 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-6656012e-be1a-488c-84a8-7edcebcb4c4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:16.533652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-6656012e-be1a-488c-84a8-7edcebcb4c4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:16.535144 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-6656012e-be1a-488c-84a8-7edcebcb4c4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:16.536488 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-6656012e-be1a-488c-84a8-7edcebcb4c4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1597 microversion: 2.20 time: 0.160497 Jun 07 14:28:16.537047 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 385/736] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:28:16 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1597 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:28:16.555019 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-4682dcdc-be23-456c-ad42-244a2aeeab08 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:16.555662 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-4682dcdc-be23-456c-ad42-244a2aeeab08 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:16.561787 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4682dcdc-be23-456c-ad42-244a2aeeab08 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:16.562240 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4682dcdc-be23-456c-ad42-244a2aeeab08 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:16.563006 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4682dcdc-be23-456c-ad42-244a2aeeab08 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:16.563488 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4682dcdc-be23-456c-ad42-244a2aeeab08 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:16.659553 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-4682dcdc-be23-456c-ad42-244a2aeeab08 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.108537 Jun 07 14:28:16.660145 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 352/737] 10.222.0.81 () {60 vars in 1315 bytes} [Tue Jun 7 14:28:16 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:28:17.114034 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-cc8c1e96-10b1-4018-96a9-9b7fcb6b804e tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:17.114712 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-cc8c1e96-10b1-4018-96a9-9b7fcb6b804e tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:17.122088 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cc8c1e96-10b1-4018-96a9-9b7fcb6b804e tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:17.122547 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cc8c1e96-10b1-4018-96a9-9b7fcb6b804e tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:17.123352 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cc8c1e96-10b1-4018-96a9-9b7fcb6b804e tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:17.123789 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cc8c1e96-10b1-4018-96a9-9b7fcb6b804e tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:17.206486 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-cc8c1e96-10b1-4018-96a9-9b7fcb6b804e tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6592aab6435242dca77b854a74ced4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798b460fbb2e4be69df7f5f419844832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:17.215157 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-cc8c1e96-10b1-4018-96a9-9b7fcb6b804e tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b" status: 200 len: 1607 microversion: 2.1 time: 0.105399 Jun 07 14:28:17.216693 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 386/738] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:28:17 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b => generated 1607 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:28:17.482170 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-04ed712b-ae3a-4168-a0d1-529cdf8fa066 req-163f9b00-ebc7-436a-986d-e3fe8da60d98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8660c0c-0d13-43ac-8023-08fa4f47a54b", "name": "network-vif-deleted", "tag": "cdcc0f1d-c9a0-45ba-bcf6-633cbdd7c4c0"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:28:17.492196 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-04ed712b-ae3a-4168-a0d1-529cdf8fa066 req-163f9b00-ebc7-436a-986d-e3fe8da60d98 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:17.492660 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-04ed712b-ae3a-4168-a0d1-529cdf8fa066 req-163f9b00-ebc7-436a-986d-e3fe8da60d98 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:17.520295 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-04ed712b-ae3a-4168-a0d1-529cdf8fa066 req-163f9b00-ebc7-436a-986d-e3fe8da60d98 service nova] Creating event network-vif-deleted:cdcc0f1d-c9a0-45ba-bcf6-633cbdd7c4c0 for instance e8660c0c-0d13-43ac-8023-08fa4f47a54b on hv-cinder-83608 Jun 07 14:28:17.528303 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-04ed712b-ae3a-4168-a0d1-529cdf8fa066 req-163f9b00-ebc7-436a-986d-e3fe8da60d98 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057250 Jun 07 14:28:17.531390 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 353/739] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:28:17.673157 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-16ea8747-8395-4fcc-8789-fd74c2193c0f req-dfc01353-9888-4990-8abb-4e2ade991910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2ed6c33-30a8-4a3b-aba5-57610c2ec718", "tag": "3f5b3dca-4f2b-407e-9796-9a5c5a344abb"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:28:17.682211 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-16ea8747-8395-4fcc-8789-fd74c2193c0f req-dfc01353-9888-4990-8abb-4e2ade991910 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:17.683616 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-16ea8747-8395-4fcc-8789-fd74c2193c0f req-dfc01353-9888-4990-8abb-4e2ade991910 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:17.696181 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-16ea8747-8395-4fcc-8789-fd74c2193c0f req-dfc01353-9888-4990-8abb-4e2ade991910 service nova] Creating event network-changed:3f5b3dca-4f2b-407e-9796-9a5c5a344abb for instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718 on hv-cinder-83608 Jun 07 14:28:17.702335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-16ea8747-8395-4fcc-8789-fd74c2193c0f req-dfc01353-9888-4990-8abb-4e2ade991910 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032763 Jun 07 14:28:17.703690 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 387/740] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:28:18.234426 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-58f47a8f-5c30-40ac-972c-3cbdc19ba531 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:18.235462 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-58f47a8f-5c30-40ac-972c-3cbdc19ba531 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:18.242717 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-58f47a8f-5c30-40ac-972c-3cbdc19ba531 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:18.243458 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-58f47a8f-5c30-40ac-972c-3cbdc19ba531 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:18.244402 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-58f47a8f-5c30-40ac-972c-3cbdc19ba531 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:18.245615 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-58f47a8f-5c30-40ac-972c-3cbdc19ba531 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:18.423681 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-58f47a8f-5c30-40ac-972c-3cbdc19ba531 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] HTTP exception thrown: Instance e8660c0c-0d13-43ac-8023-08fa4f47a54b could not be found. Jun 07 14:28:18.425655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-58f47a8f-5c30-40ac-972c-3cbdc19ba531 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Request method failure captured: Jun 07 14:28:18.425655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b HTTP/1.1 Jun 07 14:28:18.425655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 07 14:28:18.425655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 07 14:28:18.425655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Connection: close Jun 07 14:28:18.425655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 07 14:28:18.425655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 07 14:28:18.425655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Host: 10.222.0.81 Jun 07 14:28:18.425655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 07 14:28:18.425655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 07 14:28:18.425655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABin17zGFzn9BNnNGcNS_NYxDyGpTEsry97j4qlwQiv4PwNtocbq5GO4BjVsaokumbpghiNGjH8wwsTc85YthCbprc52Zopi5qHXPPdKBVJVINiPZnakzMbAv5EbiPLcH7gXBRiiez1aqy8jTOiCXM9joX7OZQXSNdnCpQGI3CabKjhdn0 Jun 07 14:28:18.425655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 07 14:28:18.425655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 07 14:28:18.425655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 07 14:28:18.425655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 07 14:28:18.425655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 07 14:28:18.425655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 07 14:28:18.425655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Id: 798b460fbb2e4be69df7f5f419844832 Jun 07 14:28:18.425655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-AttachVolumeTestJSON-1474016573 Jun 07 14:28:18.425655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Role: member,reader Jun 07 14:28:18.425655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Roles: member,reader Jun 07 14:28:18.427061 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/798b460fbb2e4be69df7f5f419844832"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_798b460fbb2e4be69df7f5f419844832", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/798b460fbb2e4be69df7f5f419844832"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/798b460fbb2e4be69df7f5f419844832"}]}] Jun 07 14:28:18.427061 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-AttachVolumeTestJSON-1474016573 Jun 07 14:28:18.427061 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 798b460fbb2e4be69df7f5f419844832 Jun 07 14:28:18.427061 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1474016573 Jun 07 14:28:18.427061 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User: tempest-AttachVolumeTestJSON-1474016573-project Jun 07 14:28:18.427061 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 07 14:28:18.427061 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 07 14:28:18.427061 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Id: 6592aab6435242dca77b854a74ced4f2 Jun 07 14:28:18.427061 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-AttachVolumeTestJSON-1474016573-project Jun 07 14:28:18.427061 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: method: > Jun 07 14:28:18.427061 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: exception: Instance e8660c0c-0d13-43ac-8023-08fa4f47a54b could not be found. Jun 07 14:28:18.427061 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: action_args: {'id': 'e8660c0c-0d13-43ac-8023-08fa4f47a54b'} Jun 07 14:28:18.431411 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:28:18.431411 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:28:18.431411 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:28:18.431411 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:28:18.431411 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:28:18.431411 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:28:18.431411 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:28:18.431411 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:28:18.431411 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:28:18.431411 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:28:18.431411 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8660c0c-0d13-43ac-8023-08fa4f47a54b could not be found. Jun 07 14:28:18.431411 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:28:18.431411 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:28:18.431411 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:28:18.431411 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:28:18.431411 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:28:18.431411 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:28:18.431411 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:28:18.431411 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:28:18.431411 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:28:18.433679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:28:18.433679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:28:18.433679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:28:18.433679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:28:18.433679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:28:18.433679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:28:18.433679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:28:18.433679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8660c0c-0d13-43ac-8023-08fa4f47a54b could not be found. Jun 07 14:28:18.433679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:28:18.433679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:28:18.433679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:28:18.433679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:28:18.433679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:28:18.433679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:28:18.433679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:28:18.433679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:28:18.433679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8660c0c-0d13-43ac-8023-08fa4f47a54b could not be found. Jun 07 14:28:18.433679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:28:18.436078 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-58f47a8f-5c30-40ac-972c-3cbdc19ba531 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Returning 404 to user: Instance e8660c0c-0d13-43ac-8023-08fa4f47a54b could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:28:18.436078 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-58f47a8f-5c30-40ac-972c-3cbdc19ba531 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b" status: 404 len: 111 microversion: 2.1 time: 0.197575 Jun 07 14:28:18.436078 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 354/741] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:28:18 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:28:18.437901 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-bf343728-e783-435f-8e80-4291f13db106 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '.version_select at 0x7ff37f666790>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:18.458085 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-bf343728-e783-435f-8e80-4291f13db106 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1516919369" status: 202 len: 0 microversion: 2.1 time: 0.025421 Jun 07 14:28:18.462778 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 388/742] 10.222.0.81 () {58 vars in 1220 bytes} [Tue Jun 7 14:28:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1516919369 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 14:28:21.407512 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1cbfa9a2-c607-4cfb-af25-d92ab789c162 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:21.408010 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1cbfa9a2-c607-4cfb-af25-d92ab789c162 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:21.414990 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1cbfa9a2-c607-4cfb-af25-d92ab789c162 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:21.415471 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1cbfa9a2-c607-4cfb-af25-d92ab789c162 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:21.416235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1cbfa9a2-c607-4cfb-af25-d92ab789c162 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:21.416664 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1cbfa9a2-c607-4cfb-af25-d92ab789c162 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:21.430176 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-1cbfa9a2-c607-4cfb-af25-d92ab789c162 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] HTTP exception thrown: Instance e8660c0c-0d13-43ac-8023-08fa4f47a54b could not be found. Jun 07 14:28:21.431727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1cbfa9a2-c607-4cfb-af25-d92ab789c162 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Request method failure captured: Jun 07 14:28:21.431727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: request: DELETE /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b HTTP/1.1 Jun 07 14:28:21.431727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 07 14:28:21.431727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 07 14:28:21.431727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Connection: close Jun 07 14:28:21.431727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 07 14:28:21.431727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 07 14:28:21.431727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Host: 10.222.0.81 Jun 07 14:28:21.431727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 07 14:28:21.431727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 07 14:28:21.431727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABin17zGFzn9BNnNGcNS_NYxDyGpTEsry97j4qlwQiv4PwNtocbq5GO4BjVsaokumbpghiNGjH8wwsTc85YthCbprc52Zopi5qHXPPdKBVJVINiPZnakzMbAv5EbiPLcH7gXBRiiez1aqy8jTOiCXM9joX7OZQXSNdnCpQGI3CabKjhdn0 Jun 07 14:28:21.431727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 07 14:28:21.431727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 07 14:28:21.431727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 07 14:28:21.431727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 07 14:28:21.431727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 07 14:28:21.431727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 07 14:28:21.431727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Id: 798b460fbb2e4be69df7f5f419844832 Jun 07 14:28:21.431727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-AttachVolumeTestJSON-1474016573 Jun 07 14:28:21.431727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Role: member,reader Jun 07 14:28:21.431727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Roles: member,reader Jun 07 14:28:21.433491 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/798b460fbb2e4be69df7f5f419844832"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_798b460fbb2e4be69df7f5f419844832", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/798b460fbb2e4be69df7f5f419844832"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/798b460fbb2e4be69df7f5f419844832"}]}] Jun 07 14:28:21.433491 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-AttachVolumeTestJSON-1474016573 Jun 07 14:28:21.433491 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 798b460fbb2e4be69df7f5f419844832 Jun 07 14:28:21.433491 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1474016573 Jun 07 14:28:21.433491 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User: tempest-AttachVolumeTestJSON-1474016573-project Jun 07 14:28:21.433491 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 07 14:28:21.433491 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 07 14:28:21.433491 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Id: 6592aab6435242dca77b854a74ced4f2 Jun 07 14:28:21.433491 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-AttachVolumeTestJSON-1474016573-project Jun 07 14:28:21.433491 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: method: > Jun 07 14:28:21.433491 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: exception: Instance e8660c0c-0d13-43ac-8023-08fa4f47a54b could not be found. Jun 07 14:28:21.433491 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: action_args: {'id': 'e8660c0c-0d13-43ac-8023-08fa4f47a54b'} Jun 07 14:28:21.434330 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:28:21.434330 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:28:21.434330 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:28:21.434330 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:28:21.434330 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:28:21.434330 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:28:21.434330 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:28:21.434330 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:28:21.434330 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:28:21.434330 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:28:21.434330 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8660c0c-0d13-43ac-8023-08fa4f47a54b could not be found. Jun 07 14:28:21.434330 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:28:21.434330 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:28:21.434330 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:28:21.434330 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:28:21.434330 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:28:21.434330 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:28:21.434330 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:28:21.434330 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:28:21.434330 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:28:21.435650 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:28:21.435650 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 14:28:21.435650 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 14:28:21.435650 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 14:28:21.435650 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 14:28:21.435650 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:28:21.435650 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:28:21.435650 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:28:21.435650 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:28:21.435650 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8660c0c-0d13-43ac-8023-08fa4f47a54b could not be found. Jun 07 14:28:21.435650 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:28:21.435650 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:28:21.435650 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:28:21.435650 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:28:21.435650 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:28:21.435650 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:28:21.435650 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:28:21.435650 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:28:21.435650 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8660c0c-0d13-43ac-8023-08fa4f47a54b could not be found. Jun 07 14:28:21.435650 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:28:21.436890 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1cbfa9a2-c607-4cfb-af25-d92ab789c162 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Returning 404 to user: Instance e8660c0c-0d13-43ac-8023-08fa4f47a54b could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:28:21.436890 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1cbfa9a2-c607-4cfb-af25-d92ab789c162 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b" status: 404 len: 111 microversion: 2.1 time: 0.029600 Jun 07 14:28:21.436890 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 355/743] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:28:21 2022] DELETE /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:28:21.442202 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-a1ba7928-ab31-42d3-9c9f-3163c0fec928 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:21.443000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-a1ba7928-ab31-42d3-9c9f-3163c0fec928 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: e8660c0c-0d13-43ac-8023-08fa4f47a54b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:21.449582 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a1ba7928-ab31-42d3-9c9f-3163c0fec928 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:21.450041 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a1ba7928-ab31-42d3-9c9f-3163c0fec928 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:21.450842 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a1ba7928-ab31-42d3-9c9f-3163c0fec928 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:21.451306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a1ba7928-ab31-42d3-9c9f-3163c0fec928 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:21.464935 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-a1ba7928-ab31-42d3-9c9f-3163c0fec928 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] HTTP exception thrown: Instance e8660c0c-0d13-43ac-8023-08fa4f47a54b could not be found. Jun 07 14:28:21.466795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-a1ba7928-ab31-42d3-9c9f-3163c0fec928 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Request method failure captured: Jun 07 14:28:21.466795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b HTTP/1.1 Jun 07 14:28:21.466795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:28:21.466795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:28:21.466795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:28:21.466795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:28:21.466795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:28:21.466795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:28:21.466795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:28:21.466795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:28:21.466795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin17zGFzn9BNnNGcNS_NYxDyGpTEsry97j4qlwQiv4PwNtocbq5GO4BjVsaokumbpghiNGjH8wwsTc85YthCbprc52Zopi5qHXPPdKBVJVINiPZnakzMbAv5EbiPLcH7gXBRiiez1aqy8jTOiCXM9joX7OZQXSNdnCpQGI3CabKjhdn0 Jun 07 14:28:21.466795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:28:21.466795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:28:21.466795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:28:21.466795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:28:21.466795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:28:21.466795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:28:21.466795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: 798b460fbb2e4be69df7f5f419844832 Jun 07 14:28:21.466795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-AttachVolumeTestJSON-1474016573 Jun 07 14:28:21.466795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:28:21.466795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:28:21.468361 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/798b460fbb2e4be69df7f5f419844832"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_798b460fbb2e4be69df7f5f419844832", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/798b460fbb2e4be69df7f5f419844832"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/798b460fbb2e4be69df7f5f419844832"}]}] Jun 07 14:28:21.468361 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-AttachVolumeTestJSON-1474016573 Jun 07 14:28:21.468361 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: 798b460fbb2e4be69df7f5f419844832 Jun 07 14:28:21.468361 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1474016573 Jun 07 14:28:21.468361 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-AttachVolumeTestJSON-1474016573-project Jun 07 14:28:21.468361 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:28:21.468361 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:28:21.468361 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: 6592aab6435242dca77b854a74ced4f2 Jun 07 14:28:21.468361 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-AttachVolumeTestJSON-1474016573-project Jun 07 14:28:21.468361 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:28:21.468361 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance e8660c0c-0d13-43ac-8023-08fa4f47a54b could not be found. Jun 07 14:28:21.468361 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': 'e8660c0c-0d13-43ac-8023-08fa4f47a54b'} Jun 07 14:28:21.469254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:28:21.469254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:28:21.469254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:28:21.469254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:28:21.469254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:28:21.469254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:28:21.469254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:28:21.469254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:28:21.469254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:28:21.469254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:28:21.469254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8660c0c-0d13-43ac-8023-08fa4f47a54b could not be found. Jun 07 14:28:21.469254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:28:21.469254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:28:21.469254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:28:21.469254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:28:21.469254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:28:21.469254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:28:21.469254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:28:21.469254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:28:21.469254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:28:21.470706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:28:21.470706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:28:21.470706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:28:21.470706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:28:21.470706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:28:21.470706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:28:21.470706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:28:21.470706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8660c0c-0d13-43ac-8023-08fa4f47a54b could not be found. Jun 07 14:28:21.470706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:28:21.470706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:28:21.470706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:28:21.470706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:28:21.470706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:28:21.470706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:28:21.470706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:28:21.470706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:28:21.470706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8660c0c-0d13-43ac-8023-08fa4f47a54b could not be found. Jun 07 14:28:21.470706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:28:21.471994 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-a1ba7928-ab31-42d3-9c9f-3163c0fec928 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Returning 404 to user: Instance e8660c0c-0d13-43ac-8023-08fa4f47a54b could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:28:21.471994 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-a1ba7928-ab31-42d3-9c9f-3163c0fec928 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b" status: 404 len: 111 microversion: 2.1 time: 0.030417 Jun 07 14:28:21.471994 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 389/744] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:28:21 2022] GET /compute/v2.1/servers/e8660c0c-0d13-43ac-8023-08fa4f47a54b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:28:22.599428 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-bfa5797b-1b05-4760-8bc0-463127608d25 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:22.599926 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-bfa5797b-1b05-4760-8bc0-463127608d25 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:22.606993 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bfa5797b-1b05-4760-8bc0-463127608d25 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:22.607474 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bfa5797b-1b05-4760-8bc0-463127608d25 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:22.608241 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bfa5797b-1b05-4760-8bc0-463127608d25 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:22.608682 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bfa5797b-1b05-4760-8bc0-463127608d25 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:22.622288 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-bfa5797b-1b05-4760-8bc0-463127608d25 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] HTTP exception thrown: Instance ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b could not be found. Jun 07 14:28:22.623894 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-bfa5797b-1b05-4760-8bc0-463127608d25 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Request method failure captured: Jun 07 14:28:22.623894 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: request: DELETE /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b HTTP/1.1 Jun 07 14:28:22.623894 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 07 14:28:22.623894 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 07 14:28:22.623894 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Connection: close Jun 07 14:28:22.623894 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 07 14:28:22.623894 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 07 14:28:22.623894 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Host: 10.222.0.81 Jun 07 14:28:22.623894 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 07 14:28:22.623894 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 07 14:28:22.623894 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABin17zGFzn9BNnNGcNS_NYxDyGpTEsry97j4qlwQiv4PwNtocbq5GO4BjVsaokumbpghiNGjH8wwsTc85YthCbprc52Zopi5qHXPPdKBVJVINiPZnakzMbAv5EbiPLcH7gXBRiiez1aqy8jTOiCXM9joX7OZQXSNdnCpQGI3CabKjhdn0 Jun 07 14:28:22.623894 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 07 14:28:22.623894 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 07 14:28:22.623894 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 07 14:28:22.623894 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 07 14:28:22.623894 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 07 14:28:22.623894 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 07 14:28:22.623894 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Id: 798b460fbb2e4be69df7f5f419844832 Jun 07 14:28:22.623894 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-AttachVolumeTestJSON-1474016573 Jun 07 14:28:22.623894 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Role: member,reader Jun 07 14:28:22.623894 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Roles: member,reader Jun 07 14:28:22.626394 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/798b460fbb2e4be69df7f5f419844832"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_798b460fbb2e4be69df7f5f419844832", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/798b460fbb2e4be69df7f5f419844832"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/798b460fbb2e4be69df7f5f419844832"}]}] Jun 07 14:28:22.626394 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-AttachVolumeTestJSON-1474016573 Jun 07 14:28:22.626394 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 798b460fbb2e4be69df7f5f419844832 Jun 07 14:28:22.626394 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1474016573 Jun 07 14:28:22.626394 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User: tempest-AttachVolumeTestJSON-1474016573-project Jun 07 14:28:22.626394 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 07 14:28:22.626394 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 07 14:28:22.626394 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Id: 6592aab6435242dca77b854a74ced4f2 Jun 07 14:28:22.626394 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-AttachVolumeTestJSON-1474016573-project Jun 07 14:28:22.626394 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: method: > Jun 07 14:28:22.626394 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: exception: Instance ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b could not be found. Jun 07 14:28:22.626394 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: action_args: {'id': 'ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b'} Jun 07 14:28:22.628073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:28:22.628073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:28:22.628073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:28:22.628073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:28:22.628073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:28:22.628073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:28:22.628073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:28:22.628073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:28:22.628073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:28:22.628073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:28:22.628073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b could not be found. Jun 07 14:28:22.628073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:28:22.628073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:28:22.628073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:28:22.628073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:28:22.628073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:28:22.628073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:28:22.628073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:28:22.628073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:28:22.628073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:28:22.630778 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:28:22.630778 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 14:28:22.630778 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 14:28:22.630778 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 14:28:22.630778 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 14:28:22.630778 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:28:22.630778 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:28:22.630778 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:28:22.630778 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:28:22.630778 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b could not be found. Jun 07 14:28:22.630778 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:28:22.630778 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:28:22.630778 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:28:22.630778 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:28:22.630778 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:28:22.630778 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:28:22.630778 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:28:22.630778 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:28:22.630778 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b could not be found. Jun 07 14:28:22.630778 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:28:22.633433 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-bfa5797b-1b05-4760-8bc0-463127608d25 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Returning 404 to user: Instance ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:28:22.633433 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-bfa5797b-1b05-4760-8bc0-463127608d25 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 404 len: 111 microversion: 2.1 time: 0.029650 Jun 07 14:28:22.633433 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 356/745] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:28:22 2022] DELETE /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:28:22.637064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-74274ebb-ce3c-4ab7-b085-c8c26e9f8129 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:22.637691 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-74274ebb-ce3c-4ab7-b085-c8c26e9f8129 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] [instance: ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:22.644133 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-74274ebb-ce3c-4ab7-b085-c8c26e9f8129 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:22.644586 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-74274ebb-ce3c-4ab7-b085-c8c26e9f8129 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:22.645353 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-74274ebb-ce3c-4ab7-b085-c8c26e9f8129 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:22.645790 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-74274ebb-ce3c-4ab7-b085-c8c26e9f8129 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:22.660880 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-74274ebb-ce3c-4ab7-b085-c8c26e9f8129 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] HTTP exception thrown: Instance ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b could not be found. Jun 07 14:28:22.662399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-74274ebb-ce3c-4ab7-b085-c8c26e9f8129 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Request method failure captured: Jun 07 14:28:22.662399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b HTTP/1.1 Jun 07 14:28:22.662399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:28:22.662399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:28:22.662399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:28:22.662399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:28:22.662399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:28:22.662399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:28:22.662399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:28:22.662399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:28:22.662399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin17zGFzn9BNnNGcNS_NYxDyGpTEsry97j4qlwQiv4PwNtocbq5GO4BjVsaokumbpghiNGjH8wwsTc85YthCbprc52Zopi5qHXPPdKBVJVINiPZnakzMbAv5EbiPLcH7gXBRiiez1aqy8jTOiCXM9joX7OZQXSNdnCpQGI3CabKjhdn0 Jun 07 14:28:22.662399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:28:22.662399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:28:22.662399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:28:22.662399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:28:22.662399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:28:22.662399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:28:22.662399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: 798b460fbb2e4be69df7f5f419844832 Jun 07 14:28:22.662399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-AttachVolumeTestJSON-1474016573 Jun 07 14:28:22.662399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:28:22.662399 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:28:22.663992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/798b460fbb2e4be69df7f5f419844832"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_798b460fbb2e4be69df7f5f419844832", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/798b460fbb2e4be69df7f5f419844832"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/798b460fbb2e4be69df7f5f419844832"}]}] Jun 07 14:28:22.663992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-AttachVolumeTestJSON-1474016573 Jun 07 14:28:22.663992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: 798b460fbb2e4be69df7f5f419844832 Jun 07 14:28:22.663992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1474016573 Jun 07 14:28:22.663992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-AttachVolumeTestJSON-1474016573-project Jun 07 14:28:22.663992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:28:22.663992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:28:22.663992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: 6592aab6435242dca77b854a74ced4f2 Jun 07 14:28:22.663992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-AttachVolumeTestJSON-1474016573-project Jun 07 14:28:22.663992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:28:22.663992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b could not be found. Jun 07 14:28:22.663992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': 'ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b'} Jun 07 14:28:22.664860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:28:22.664860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:28:22.664860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:28:22.664860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:28:22.664860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:28:22.664860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:28:22.664860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:28:22.664860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:28:22.664860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:28:22.664860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:28:22.664860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b could not be found. Jun 07 14:28:22.664860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:28:22.664860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:28:22.664860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:28:22.664860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:28:22.664860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:28:22.664860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:28:22.664860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:28:22.664860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:28:22.664860 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:28:22.666285 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:28:22.666285 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:28:22.666285 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:28:22.666285 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:28:22.666285 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:28:22.666285 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:28:22.666285 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:28:22.666285 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b could not be found. Jun 07 14:28:22.666285 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:28:22.666285 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:28:22.666285 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:28:22.666285 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:28:22.666285 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:28:22.666285 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:28:22.666285 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:28:22.666285 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:28:22.666285 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b could not be found. Jun 07 14:28:22.666285 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:28:22.668117 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-74274ebb-ce3c-4ab7-b085-c8c26e9f8129 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] Returning 404 to user: Instance ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:28:22.668117 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-74274ebb-ce3c-4ab7-b085-c8c26e9f8129 tempest-AttachVolumeTestJSON-1474016573 tempest-AttachVolumeTestJSON-1474016573-project] 10.222.0.81 "GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b" status: 404 len: 111 microversion: 2.1 time: 0.032321 Jun 07 14:28:22.668117 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 390/746] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:28:22 2022] GET /compute/v2.1/servers/ed4789cf-bc6b-4fe2-b6e0-3d4defe8924b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:28:54.088911 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=27 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:54.089642 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=38 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:54.094759 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-254af178-ff2d-4d4c-9c11-af24748e1196 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:54.095268 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-254af178-ff2d-4d4c-9c11-af24748e1196 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:54.102188 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-254af178-ff2d-4d4c-9c11-af24748e1196 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:54.102637 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-254af178-ff2d-4d4c-9c11-af24748e1196 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:54.103469 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-254af178-ff2d-4d4c-9c11-af24748e1196 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:54.103908 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-254af178-ff2d-4d4c-9c11-af24748e1196 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:54.128461 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-254af178-ff2d-4d4c-9c11-af24748e1196 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718/ips" status: 200 len: 151 microversion: 2.20 time: 0.040797 Jun 07 14:28:54.129016 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 357/747] 10.222.0.81 () {60 vars in 1288 bytes} [Tue Jun 7 14:28:54 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:28:56.661396 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-79d189e2-3cd9-498d-a4b3-28bbb88b9e94 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:28:56.661976 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-79d189e2-3cd9-498d-a4b3-28bbb88b9e94 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:56.664257 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:56.664898 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=20 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:56.670961 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-79d189e2-3cd9-498d-a4b3-28bbb88b9e94 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:56.671536 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-79d189e2-3cd9-498d-a4b3-28bbb88b9e94 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:56.672222 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-79d189e2-3cd9-498d-a4b3-28bbb88b9e94 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:56.672659 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-79d189e2-3cd9-498d-a4b3-28bbb88b9e94 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:56.706318 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.objects.instance [None req-79d189e2-3cd9-498d-a4b3-28bbb88b9e94 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lazy-loading 'flavor' on Instance uuid a2ed6c33-30a8-4a3b-aba5-57610c2ec718 {{(pid=117565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:28:56.961669 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-79d189e2-3cd9-498d-a4b3-28bbb88b9e94 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "POST /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718/action" status: 202 len: 0 microversion: 2.20 time: 0.304196 Jun 07 14:28:56.962301 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 391/748] 10.222.0.81 () {62 vars in 1318 bytes} [Tue Jun 7 14:28:56 2022] POST /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:28:56.971702 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-cae916c0-faa1-4735-986d-41a8640d0f8e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:56.972311 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-cae916c0-faa1-4735-986d-41a8640d0f8e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:56.978716 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cae916c0-faa1-4735-986d-41a8640d0f8e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:56.979199 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cae916c0-faa1-4735-986d-41a8640d0f8e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:56.979994 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cae916c0-faa1-4735-986d-41a8640d0f8e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:56.980992 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cae916c0-faa1-4735-986d-41a8640d0f8e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:57.116906 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-cae916c0-faa1-4735-986d-41a8640d0f8e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:57.125414 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-cae916c0-faa1-4735-986d-41a8640d0f8e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:57.126914 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-cae916c0-faa1-4735-986d-41a8640d0f8e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:57.128179 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-cae916c0-faa1-4735-986d-41a8640d0f8e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1722 microversion: 2.20 time: 0.160488 Jun 07 14:28:57.128729 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 358/749] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:28:56 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:28:58.148743 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-02992e6c-9a70-4a2c-b918-5d7ccf2ca0eb tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:58.149443 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-02992e6c-9a70-4a2c-b918-5d7ccf2ca0eb tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:58.156939 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-02992e6c-9a70-4a2c-b918-5d7ccf2ca0eb tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:58.157380 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-02992e6c-9a70-4a2c-b918-5d7ccf2ca0eb tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:58.158168 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-02992e6c-9a70-4a2c-b918-5d7ccf2ca0eb tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:58.158774 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-02992e6c-9a70-4a2c-b918-5d7ccf2ca0eb tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:58.294711 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-02992e6c-9a70-4a2c-b918-5d7ccf2ca0eb tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:58.302921 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-02992e6c-9a70-4a2c-b918-5d7ccf2ca0eb tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:58.304491 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-02992e6c-9a70-4a2c-b918-5d7ccf2ca0eb tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:58.305707 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-02992e6c-9a70-4a2c-b918-5d7ccf2ca0eb tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1722 microversion: 2.20 time: 0.161804 Jun 07 14:28:58.306256 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 392/750] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:28:58 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:28:59.325592 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f8f0603e-9ec8-4ca0-a6d8-694b2b0b3109 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:28:59.326310 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f8f0603e-9ec8-4ca0-a6d8-694b2b0b3109 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:28:59.332756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f8f0603e-9ec8-4ca0-a6d8-694b2b0b3109 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:59.333183 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f8f0603e-9ec8-4ca0-a6d8-694b2b0b3109 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:59.333935 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f8f0603e-9ec8-4ca0-a6d8-694b2b0b3109 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:28:59.334367 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f8f0603e-9ec8-4ca0-a6d8-694b2b0b3109 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:28:59.471058 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f8f0603e-9ec8-4ca0-a6d8-694b2b0b3109 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:59.479180 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f8f0603e-9ec8-4ca0-a6d8-694b2b0b3109 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:59.480700 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f8f0603e-9ec8-4ca0-a6d8-694b2b0b3109 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:28:59.482793 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f8f0603e-9ec8-4ca0-a6d8-694b2b0b3109 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1722 microversion: 2.20 time: 0.161916 Jun 07 14:28:59.483367 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 359/751] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:28:59 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:00.501449 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-8b535547-c0dc-4fac-9a92-9b3073fa096b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:00.502055 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-8b535547-c0dc-4fac-9a92-9b3073fa096b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:00.508662 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8b535547-c0dc-4fac-9a92-9b3073fa096b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:00.509138 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8b535547-c0dc-4fac-9a92-9b3073fa096b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:00.509896 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8b535547-c0dc-4fac-9a92-9b3073fa096b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:00.510327 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8b535547-c0dc-4fac-9a92-9b3073fa096b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:00.642476 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8b535547-c0dc-4fac-9a92-9b3073fa096b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:00.650487 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8b535547-c0dc-4fac-9a92-9b3073fa096b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:00.652035 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8b535547-c0dc-4fac-9a92-9b3073fa096b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:00.653197 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-8b535547-c0dc-4fac-9a92-9b3073fa096b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1722 microversion: 2.20 time: 0.155958 Jun 07 14:29:00.653762 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 393/752] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:00 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:01.672455 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-79ec3d48-8e0a-4492-9cb1-db5d33536444 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:01.673061 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-79ec3d48-8e0a-4492-9cb1-db5d33536444 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:01.679520 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-79ec3d48-8e0a-4492-9cb1-db5d33536444 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:01.679973 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-79ec3d48-8e0a-4492-9cb1-db5d33536444 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:01.680736 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-79ec3d48-8e0a-4492-9cb1-db5d33536444 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:01.681170 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-79ec3d48-8e0a-4492-9cb1-db5d33536444 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:01.814186 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-79ec3d48-8e0a-4492-9cb1-db5d33536444 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:01.822076 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-79ec3d48-8e0a-4492-9cb1-db5d33536444 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:01.823597 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-79ec3d48-8e0a-4492-9cb1-db5d33536444 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:01.824744 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-79ec3d48-8e0a-4492-9cb1-db5d33536444 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1722 microversion: 2.20 time: 0.156854 Jun 07 14:29:01.825292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 360/753] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:01 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:02.843720 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-8b0c5754-2635-4be0-bac0-55b9e6f5ba27 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:02.844336 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-8b0c5754-2635-4be0-bac0-55b9e6f5ba27 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:02.850779 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8b0c5754-2635-4be0-bac0-55b9e6f5ba27 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:02.851238 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8b0c5754-2635-4be0-bac0-55b9e6f5ba27 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:02.852017 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8b0c5754-2635-4be0-bac0-55b9e6f5ba27 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:02.852452 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8b0c5754-2635-4be0-bac0-55b9e6f5ba27 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:02.985183 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8b0c5754-2635-4be0-bac0-55b9e6f5ba27 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:02.993058 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8b0c5754-2635-4be0-bac0-55b9e6f5ba27 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:02.994597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8b0c5754-2635-4be0-bac0-55b9e6f5ba27 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:02.995795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-8b0c5754-2635-4be0-bac0-55b9e6f5ba27 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1722 microversion: 2.20 time: 0.156832 Jun 07 14:29:02.996364 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 394/754] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:02 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:04.013737 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ee39148c-86bf-4185-bf8e-e32e7253241e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:04.015062 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ee39148c-86bf-4185-bf8e-e32e7253241e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:04.021547 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ee39148c-86bf-4185-bf8e-e32e7253241e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:04.021996 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ee39148c-86bf-4185-bf8e-e32e7253241e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:04.022876 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ee39148c-86bf-4185-bf8e-e32e7253241e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:04.023388 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ee39148c-86bf-4185-bf8e-e32e7253241e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:04.150332 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ee39148c-86bf-4185-bf8e-e32e7253241e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:04.158374 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ee39148c-86bf-4185-bf8e-e32e7253241e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:04.159927 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ee39148c-86bf-4185-bf8e-e32e7253241e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:04.161084 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ee39148c-86bf-4185-bf8e-e32e7253241e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1722 microversion: 2.20 time: 0.151327 Jun 07 14:29:04.161667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 361/755] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:04 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:05.180351 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ced997bf-139f-4f73-a4d2-c5e1d95bfce9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:05.180964 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ced997bf-139f-4f73-a4d2-c5e1d95bfce9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:05.188395 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ced997bf-139f-4f73-a4d2-c5e1d95bfce9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:05.188846 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ced997bf-139f-4f73-a4d2-c5e1d95bfce9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:05.189603 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ced997bf-139f-4f73-a4d2-c5e1d95bfce9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:05.190051 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ced997bf-139f-4f73-a4d2-c5e1d95bfce9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:05.571727 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ced997bf-139f-4f73-a4d2-c5e1d95bfce9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:05.579929 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ced997bf-139f-4f73-a4d2-c5e1d95bfce9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:05.581421 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ced997bf-139f-4f73-a4d2-c5e1d95bfce9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:05.582562 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ced997bf-139f-4f73-a4d2-c5e1d95bfce9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1722 microversion: 2.20 time: 0.406184 Jun 07 14:29:05.583116 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 395/756] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:05 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1722 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:06.601401 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-91ded0bd-ea26-4f66-b1fa-da9c64d5fb36 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:06.602297 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-91ded0bd-ea26-4f66-b1fa-da9c64d5fb36 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:06.608415 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-91ded0bd-ea26-4f66-b1fa-da9c64d5fb36 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:06.609449 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-91ded0bd-ea26-4f66-b1fa-da9c64d5fb36 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:06.610302 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-91ded0bd-ea26-4f66-b1fa-da9c64d5fb36 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:06.610836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-91ded0bd-ea26-4f66-b1fa-da9c64d5fb36 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:06.752285 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-91ded0bd-ea26-4f66-b1fa-da9c64d5fb36 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:06.760736 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-91ded0bd-ea26-4f66-b1fa-da9c64d5fb36 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:06.762345 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-91ded0bd-ea26-4f66-b1fa-da9c64d5fb36 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:06.763620 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-91ded0bd-ea26-4f66-b1fa-da9c64d5fb36 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1722 microversion: 2.20 time: 0.166817 Jun 07 14:29:06.764532 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 362/757] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:06 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:06.830237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3539d446-6469-42a5-8bd7-3c82c3339ec1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:06.830728 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-3539d446-6469-42a5-8bd7-3c82c3339ec1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:06.833221 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-479af0db-b122-456f-8a4b-17e231790d0e req-50bb6308-18a1-460e-9bf0-3c63656428a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2714c53-3b93-4d50-9812-e5f0a324b286", "tag": "cd19e240-c912-408d-ac68-5ada3a1dd139"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:29:06.838141 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3539d446-6469-42a5-8bd7-3c82c3339ec1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:06.838588 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3539d446-6469-42a5-8bd7-3c82c3339ec1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:06.839377 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3539d446-6469-42a5-8bd7-3c82c3339ec1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:06.839810 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3539d446-6469-42a5-8bd7-3c82c3339ec1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:06.842079 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-479af0db-b122-456f-8a4b-17e231790d0e req-50bb6308-18a1-460e-9bf0-3c63656428a3 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:06.842600 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-479af0db-b122-456f-8a4b-17e231790d0e req-50bb6308-18a1-460e-9bf0-3c63656428a3 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:06.854658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-479af0db-b122-456f-8a4b-17e231790d0e req-50bb6308-18a1-460e-9bf0-3c63656428a3 service nova] Creating event network-changed:cd19e240-c912-408d-ac68-5ada3a1dd139 for instance e2714c53-3b93-4d50-9812-e5f0a324b286 on hv-cinder-83608 Jun 07 14:29:06.860714 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-479af0db-b122-456f-8a4b-17e231790d0e req-50bb6308-18a1-460e-9bf0-3c63656428a3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031257 Jun 07 14:29:06.861311 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 363/758] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:29:06.870032 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-3539d446-6469-42a5-8bd7-3c82c3339ec1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Going to try to terminate instance {{(pid=117565) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:29:06.961027 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-3539d446-6469-42a5-8bd7-3c82c3339ec1 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 204 len: 0 microversion: 2.1 time: 0.134834 Jun 07 14:29:06.964207 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 396/759] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:29:06 2022] DELETE /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:29:06.973813 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6325526f-5b52-4987-aad7-80be128dfa21 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:06.974779 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-6325526f-5b52-4987-aad7-80be128dfa21 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:06.981094 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6325526f-5b52-4987-aad7-80be128dfa21 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:06.981543 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6325526f-5b52-4987-aad7-80be128dfa21 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:06.982479 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6325526f-5b52-4987-aad7-80be128dfa21 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:06.982920 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6325526f-5b52-4987-aad7-80be128dfa21 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:07.141269 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-6325526f-5b52-4987-aad7-80be128dfa21 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:07.149031 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6325526f-5b52-4987-aad7-80be128dfa21 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1569 microversion: 2.1 time: 0.179392 Jun 07 14:29:07.149829 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 364/760] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:06 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:07.783079 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3429e025-01da-4dda-bc5b-3a841ca1285e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:07.783899 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-3429e025-01da-4dda-bc5b-3a841ca1285e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:07.790273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3429e025-01da-4dda-bc5b-3a841ca1285e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:07.790725 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3429e025-01da-4dda-bc5b-3a841ca1285e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:07.791648 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3429e025-01da-4dda-bc5b-3a841ca1285e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:07.792234 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3429e025-01da-4dda-bc5b-3a841ca1285e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:07.967186 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-3429e025-01da-4dda-bc5b-3a841ca1285e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:07.975841 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-3429e025-01da-4dda-bc5b-3a841ca1285e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:07.977347 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-3429e025-01da-4dda-bc5b-3a841ca1285e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:07.978511 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-3429e025-01da-4dda-bc5b-3a841ca1285e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1722 microversion: 2.20 time: 0.200393 Jun 07 14:29:07.979072 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 397/761] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:07 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:08.167311 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-fcd43134-b4b0-4a30-9dba-9872d4331bdf tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:08.168317 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-fcd43134-b4b0-4a30-9dba-9872d4331bdf tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:08.174996 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fcd43134-b4b0-4a30-9dba-9872d4331bdf tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:08.175481 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fcd43134-b4b0-4a30-9dba-9872d4331bdf tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:08.176257 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fcd43134-b4b0-4a30-9dba-9872d4331bdf tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:08.176695 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fcd43134-b4b0-4a30-9dba-9872d4331bdf tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:08.336607 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-fcd43134-b4b0-4a30-9dba-9872d4331bdf tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:08.345261 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-fcd43134-b4b0-4a30-9dba-9872d4331bdf tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1569 microversion: 2.1 time: 0.181925 Jun 07 14:29:08.345829 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 365/762] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:08 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:08.997653 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-f4a684cc-9dc5-4a19-bd88-5cc1be26e622 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:08.998179 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-f4a684cc-9dc5-4a19-bd88-5cc1be26e622 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:09.005237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f4a684cc-9dc5-4a19-bd88-5cc1be26e622 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:09.005683 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f4a684cc-9dc5-4a19-bd88-5cc1be26e622 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:09.006443 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f4a684cc-9dc5-4a19-bd88-5cc1be26e622 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:09.006879 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f4a684cc-9dc5-4a19-bd88-5cc1be26e622 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:09.152368 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-f4a684cc-9dc5-4a19-bd88-5cc1be26e622 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:09.164259 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-f4a684cc-9dc5-4a19-bd88-5cc1be26e622 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:09.166730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-f4a684cc-9dc5-4a19-bd88-5cc1be26e622 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:09.168454 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-f4a684cc-9dc5-4a19-bd88-5cc1be26e622 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1722 microversion: 2.20 time: 0.174589 Jun 07 14:29:09.173628 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-75450ce4-31c5-43b8-a681-0a4d025b1797 req-0666cea4-c75f-4c55-8904-13c4c3a7bdd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2714c53-3b93-4d50-9812-e5f0a324b286", "name": "network-vif-deleted", "tag": "cd19e240-c912-408d-ac68-5ada3a1dd139"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:29:09.192790 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 398/763] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:08 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:09.192925 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-75450ce4-31c5-43b8-a681-0a4d025b1797 req-0666cea4-c75f-4c55-8904-13c4c3a7bdd1 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:09.192925 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-75450ce4-31c5-43b8-a681-0a4d025b1797 req-0666cea4-c75f-4c55-8904-13c4c3a7bdd1 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:09.197528 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-75450ce4-31c5-43b8-a681-0a4d025b1797 req-0666cea4-c75f-4c55-8904-13c4c3a7bdd1 service nova] Creating event network-vif-deleted:cd19e240-c912-408d-ac68-5ada3a1dd139 for instance e2714c53-3b93-4d50-9812-e5f0a324b286 on hv-cinder-83608 Jun 07 14:29:09.203802 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-75450ce4-31c5-43b8-a681-0a4d025b1797 req-0666cea4-c75f-4c55-8904-13c4c3a7bdd1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033239 Jun 07 14:29:09.204587 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 366/764] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:29:09.362245 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-16173d89-2435-4fcb-b252-ff372c36913b tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:09.363002 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-16173d89-2435-4fcb-b252-ff372c36913b tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:09.369151 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-16173d89-2435-4fcb-b252-ff372c36913b tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:09.369679 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-16173d89-2435-4fcb-b252-ff372c36913b tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:09.370512 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-16173d89-2435-4fcb-b252-ff372c36913b tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:09.370958 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-16173d89-2435-4fcb-b252-ff372c36913b tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:09.434336 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-16173d89-2435-4fcb-b252-ff372c36913b tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6598d0d7c41faae54d48ea8a850d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5977f5c113f44eebed133afa6238c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:09.443330 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-16173d89-2435-4fcb-b252-ff372c36913b tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 200 len: 1220 microversion: 2.1 time: 0.085332 Jun 07 14:29:09.453590 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 399/765] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:09 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:10.188423 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0c138f67-89f5-4075-9adb-75e183a04fa9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:10.189129 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0c138f67-89f5-4075-9adb-75e183a04fa9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:10.195419 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0c138f67-89f5-4075-9adb-75e183a04fa9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:10.195875 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0c138f67-89f5-4075-9adb-75e183a04fa9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:10.196642 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0c138f67-89f5-4075-9adb-75e183a04fa9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:10.197085 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0c138f67-89f5-4075-9adb-75e183a04fa9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:10.327590 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0c138f67-89f5-4075-9adb-75e183a04fa9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:10.335602 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0c138f67-89f5-4075-9adb-75e183a04fa9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:10.337117 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0c138f67-89f5-4075-9adb-75e183a04fa9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:10.338280 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0c138f67-89f5-4075-9adb-75e183a04fa9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1722 microversion: 2.20 time: 0.154887 Jun 07 14:29:10.338839 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 367/766] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:10 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:10.460452 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-63902f0e-ebaf-4485-a754-fc38152ff19c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:10.461153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-63902f0e-ebaf-4485-a754-fc38152ff19c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] [instance: e2714c53-3b93-4d50-9812-e5f0a324b286] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:10.468667 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-63902f0e-ebaf-4485-a754-fc38152ff19c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:10.469130 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-63902f0e-ebaf-4485-a754-fc38152ff19c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:10.469956 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-63902f0e-ebaf-4485-a754-fc38152ff19c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:10.470398 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-63902f0e-ebaf-4485-a754-fc38152ff19c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:10.484319 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-63902f0e-ebaf-4485-a754-fc38152ff19c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] HTTP exception thrown: Instance e2714c53-3b93-4d50-9812-e5f0a324b286 could not be found. Jun 07 14:29:10.485973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-63902f0e-ebaf-4485-a754-fc38152ff19c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Request method failure captured: Jun 07 14:29:10.485973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 HTTP/1.1 Jun 07 14:29:10.485973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:29:10.485973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:29:10.485973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:29:10.485973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:29:10.485973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:29:10.485973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:29:10.485973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:29:10.485973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:29:10.485973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin19i8GWtuNRUQNki1v-P6Vm_touAI8AyRHkqAx_dfYK78-6TOlmD5dS0E210fEVvaem1VhmhP166Sv4HZzukaPOzauNNYQEAVQ9sG5wYi8Th-HzPWstu0c36O2XOG5EBMNnrks6aQHC7_vP4RVf3R1gZuM5EcLEEh7qkoeVFeS9x7Hw Jun 07 14:29:10.485973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:29:10.485973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:29:10.485973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:29:10.485973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:29:10.485973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:29:10.485973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:29:10.485973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: b5977f5c113f44eebed133afa6238c2e Jun 07 14:29:10.485973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-TestShelveInstance-610123530 Jun 07 14:29:10.485973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:29:10.485973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:29:10.487649 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b5977f5c113f44eebed133afa6238c2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b5977f5c113f44eebed133afa6238c2e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5977f5c113f44eebed133afa6238c2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5977f5c113f44eebed133afa6238c2e"}]}] Jun 07 14:29:10.487649 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-TestShelveInstance-610123530 Jun 07 14:29:10.487649 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: b5977f5c113f44eebed133afa6238c2e Jun 07 14:29:10.487649 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-TestShelveInstance-610123530 Jun 07 14:29:10.487649 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-TestShelveInstance-610123530-project Jun 07 14:29:10.487649 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:29:10.487649 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:29:10.487649 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: 86a6598d0d7c41faae54d48ea8a850d7 Jun 07 14:29:10.487649 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-TestShelveInstance-610123530-project Jun 07 14:29:10.487649 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:29:10.487649 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance e2714c53-3b93-4d50-9812-e5f0a324b286 could not be found. Jun 07 14:29:10.487649 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': 'e2714c53-3b93-4d50-9812-e5f0a324b286'} Jun 07 14:29:10.488621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:29:10.488621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:29:10.488621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:29:10.488621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:29:10.488621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:29:10.488621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:29:10.488621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:29:10.488621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:29:10.488621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:29:10.488621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:29:10.488621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2714c53-3b93-4d50-9812-e5f0a324b286 could not be found. Jun 07 14:29:10.488621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:29:10.488621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:29:10.488621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:29:10.488621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:29:10.488621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:29:10.488621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:29:10.488621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:29:10.488621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:29:10.488621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:29:10.490171 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:29:10.490171 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:29:10.490171 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:29:10.490171 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:29:10.490171 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:29:10.490171 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:29:10.490171 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:29:10.490171 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2714c53-3b93-4d50-9812-e5f0a324b286 could not be found. Jun 07 14:29:10.490171 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:29:10.490171 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:29:10.490171 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:29:10.490171 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:29:10.490171 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:29:10.490171 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:29:10.490171 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:29:10.490171 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:29:10.490171 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2714c53-3b93-4d50-9812-e5f0a324b286 could not be found. Jun 07 14:29:10.490171 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:29:10.491670 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-63902f0e-ebaf-4485-a754-fc38152ff19c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Returning 404 to user: Instance e2714c53-3b93-4d50-9812-e5f0a324b286 could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:29:10.491670 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-63902f0e-ebaf-4485-a754-fc38152ff19c tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286" status: 404 len: 111 microversion: 2.1 time: 0.030905 Jun 07 14:29:10.491670 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 400/767] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:10 2022] GET /compute/v2.1/servers/e2714c53-3b93-4d50-9812-e5f0a324b286 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 14:29:10.662318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-527f336d-5924-4105-9ca9-c718a472ede2 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] Calling method '.version_select at 0x7ff37f3dab80>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:10.680615 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-527f336d-5924-4105-9ca9-c718a472ede2 tempest-TestShelveInstance-610123530 tempest-TestShelveInstance-610123530-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1960209199" status: 202 len: 0 microversion: 2.1 time: 0.022202 Jun 07 14:29:10.681594 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 368/768] 10.222.0.81 () {58 vars in 1253 bytes} [Tue Jun 7 14:29:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1960209199 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:29:11.357202 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-13e48bee-0776-4a09-8f53-75c534822e6b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:11.357863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-13e48bee-0776-4a09-8f53-75c534822e6b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:11.364031 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-13e48bee-0776-4a09-8f53-75c534822e6b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:11.364484 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-13e48bee-0776-4a09-8f53-75c534822e6b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:11.365247 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-13e48bee-0776-4a09-8f53-75c534822e6b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:11.365732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-13e48bee-0776-4a09-8f53-75c534822e6b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:11.504305 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-13e48bee-0776-4a09-8f53-75c534822e6b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:11.513510 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-13e48bee-0776-4a09-8f53-75c534822e6b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:11.515890 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-13e48bee-0776-4a09-8f53-75c534822e6b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:11.517061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-13e48bee-0776-4a09-8f53-75c534822e6b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1722 microversion: 2.20 time: 0.163777 Jun 07 14:29:11.517615 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 401/769] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:11 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:12.537488 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ad4efb86-42b3-4dcf-8b5f-e03a4538a812 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:12.538431 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ad4efb86-42b3-4dcf-8b5f-e03a4538a812 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:12.544538 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ad4efb86-42b3-4dcf-8b5f-e03a4538a812 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:12.545393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ad4efb86-42b3-4dcf-8b5f-e03a4538a812 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:12.546692 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ad4efb86-42b3-4dcf-8b5f-e03a4538a812 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:12.547314 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ad4efb86-42b3-4dcf-8b5f-e03a4538a812 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:12.792791 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ad4efb86-42b3-4dcf-8b5f-e03a4538a812 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:12.802747 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ad4efb86-42b3-4dcf-8b5f-e03a4538a812 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:12.805325 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ad4efb86-42b3-4dcf-8b5f-e03a4538a812 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:12.806855 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ad4efb86-42b3-4dcf-8b5f-e03a4538a812 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1722 microversion: 2.20 time: 0.275405 Jun 07 14:29:12.807627 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 369/770] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:12 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:29:13.832390 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-cf16633a-8482-4b10-bc9e-c4edf7e19690 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:13.833108 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-cf16633a-8482-4b10-bc9e-c4edf7e19690 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:13.849924 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cf16633a-8482-4b10-bc9e-c4edf7e19690 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:13.850348 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cf16633a-8482-4b10-bc9e-c4edf7e19690 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:13.851236 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cf16633a-8482-4b10-bc9e-c4edf7e19690 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:13.851691 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cf16633a-8482-4b10-bc9e-c4edf7e19690 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:14.098264 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-cf16633a-8482-4b10-bc9e-c4edf7e19690 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:14.108096 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-cf16633a-8482-4b10-bc9e-c4edf7e19690 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:14.110198 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-cf16633a-8482-4b10-bc9e-c4edf7e19690 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:14.111770 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-cf16633a-8482-4b10-bc9e-c4edf7e19690 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1722 microversion: 2.20 time: 0.287517 Jun 07 14:29:14.112767 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 402/771] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:13 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:29:15.130314 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2796fe03-3019-4f74-ad1a-8800d5ebf35f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:15.131640 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2796fe03-3019-4f74-ad1a-8800d5ebf35f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:15.139016 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2796fe03-3019-4f74-ad1a-8800d5ebf35f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:15.139558 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2796fe03-3019-4f74-ad1a-8800d5ebf35f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:15.140739 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2796fe03-3019-4f74-ad1a-8800d5ebf35f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:15.141339 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2796fe03-3019-4f74-ad1a-8800d5ebf35f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:15.362566 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2796fe03-3019-4f74-ad1a-8800d5ebf35f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:15.370731 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2796fe03-3019-4f74-ad1a-8800d5ebf35f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:15.372213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2796fe03-3019-4f74-ad1a-8800d5ebf35f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:15.373478 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2796fe03-3019-4f74-ad1a-8800d5ebf35f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1722 microversion: 2.20 time: 0.247263 Jun 07 14:29:15.374115 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 370/772] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:15 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:15.701601 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ace0303d-a4c3-4c37-870d-662b28b9d4c2 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1223882517", "imageRef": "2864004b-970a-480b-8453-14794f9ccca2", "flavorRef": "452"}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:29:15.756406 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.network.neutron [None req-ace0303d-a4c3-4c37-870d-662b28b9d4c2 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] validate_networks() for None {{(pid=117565) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:29:16.391285 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3e65a0c7-0a6a-4cbe-aec3-7005cfa0b70b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:16.392000 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3e65a0c7-0a6a-4cbe-aec3-7005cfa0b70b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:16.398343 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3e65a0c7-0a6a-4cbe-aec3-7005cfa0b70b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:16.398800 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3e65a0c7-0a6a-4cbe-aec3-7005cfa0b70b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:16.399604 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3e65a0c7-0a6a-4cbe-aec3-7005cfa0b70b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:16.400046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3e65a0c7-0a6a-4cbe-aec3-7005cfa0b70b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:16.432724 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-ace0303d-a4c3-4c37-870d-662b28b9d4c2 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Flavor limits 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:29:16.433264 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-ace0303d-a4c3-4c37-870d-662b28b9d4c2 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Image limits 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:29:16.433806 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-ace0303d-a4c3-4c37-870d-662b28b9d4c2 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Flavor pref 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:29:16.434307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-ace0303d-a4c3-4c37-870d-662b28b9d4c2 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Image pref 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:29:16.434946 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-ace0303d-a4c3-4c37-870d-662b28b9d4c2 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:29:16.445047 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ace0303d-a4c3-4c37-870d-662b28b9d4c2 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:16.445588 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ace0303d-a4c3-4c37-870d-662b28b9d4c2 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:16.446411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ace0303d-a4c3-4c37-870d-662b28b9d4c2 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:16.446845 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ace0303d-a4c3-4c37-870d-662b28b9d4c2 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:16.463874 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-ace0303d-a4c3-4c37-870d-662b28b9d4c2 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Getting quotas for project 6e8cfd2bd8134c328696944b1913bc41. Resources: {'ram', 'cores', 'instances'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:29:16.468939 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-ace0303d-a4c3-4c37-870d-662b28b9d4c2 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Getting quotas for user 4185a7263943447a92a15571f192b0f8 and project 6e8cfd2bd8134c328696944b1913bc41. Resources: {'ram', 'cores', 'instances'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:29:16.479880 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ace0303d-a4c3-4c37-870d-662b28b9d4c2 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Going to run 1 instances... {{(pid=117565) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:29:16.482095 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ace0303d-a4c3-4c37-870d-662b28b9d4c2 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] [instance: 2c161249-6227-4042-b88c-371e3e32503e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2864004b-970a-480b-8453-14794f9ccca2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:29:16.533723 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ace0303d-a4c3-4c37-870d-662b28b9d4c2 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.835919 Jun 07 14:29:16.539673 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 403/773] 10.222.0.81 () {60 vars in 1146 bytes} [Tue Jun 7 14:29:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:29:16.544829 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-dcaa80f5-0a36-4ddd-a6b7-5262362963bf tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:16.545487 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-dcaa80f5-0a36-4ddd-a6b7-5262362963bf tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] [instance: 2c161249-6227-4042-b88c-371e3e32503e] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:16.595781 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3e65a0c7-0a6a-4cbe-aec3-7005cfa0b70b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:16.613993 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3e65a0c7-0a6a-4cbe-aec3-7005cfa0b70b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:16.615780 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3e65a0c7-0a6a-4cbe-aec3-7005cfa0b70b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:16.618851 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3e65a0c7-0a6a-4cbe-aec3-7005cfa0b70b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1722 microversion: 2.20 time: 0.231531 Jun 07 14:29:16.620293 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-dcaa80f5-0a36-4ddd-a6b7-5262362963bf tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4185a7263943447a92a15571f192b0f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8cfd2bd8134c328696944b1913bc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:16.623657 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 371/774] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:16 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:16.639076 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-dcaa80f5-0a36-4ddd-a6b7-5262362963bf tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] 10.222.0.81 "GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e" status: 200 len: 1215 microversion: 2.1 time: 0.098199 Jun 07 14:29:16.641060 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 404/775] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:16 2022] GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e => generated 1215 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:17.643501 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-086b9606-c627-49e3-bf4b-30fe79563b94 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:17.644116 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-086b9606-c627-49e3-bf4b-30fe79563b94 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:17.656900 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-dc187796-983e-4de3-b9f7-57da8ab99871 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:17.658241 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-dc187796-983e-4de3-b9f7-57da8ab99871 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] [instance: 2c161249-6227-4042-b88c-371e3e32503e] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:17.662175 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-086b9606-c627-49e3-bf4b-30fe79563b94 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:17.663851 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-086b9606-c627-49e3-bf4b-30fe79563b94 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:17.664926 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-086b9606-c627-49e3-bf4b-30fe79563b94 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:17.667779 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-086b9606-c627-49e3-bf4b-30fe79563b94 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:17.671627 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-dc187796-983e-4de3-b9f7-57da8ab99871 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:17.673325 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-dc187796-983e-4de3-b9f7-57da8ab99871 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:17.675679 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-dc187796-983e-4de3-b9f7-57da8ab99871 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:17.677229 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-dc187796-983e-4de3-b9f7-57da8ab99871 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:17.788876 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-dc187796-983e-4de3-b9f7-57da8ab99871 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4185a7263943447a92a15571f192b0f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8cfd2bd8134c328696944b1913bc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:17.797586 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-dc187796-983e-4de3-b9f7-57da8ab99871 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] 10.222.0.81 "GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e" status: 200 len: 1273 microversion: 2.1 time: 0.144975 Jun 07 14:29:17.798752 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 405/776] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:17 2022] GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e => generated 1273 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:17.862381 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-086b9606-c627-49e3-bf4b-30fe79563b94 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:17.871023 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-086b9606-c627-49e3-bf4b-30fe79563b94 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:17.872675 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-086b9606-c627-49e3-bf4b-30fe79563b94 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:17.874350 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-086b9606-c627-49e3-bf4b-30fe79563b94 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1722 microversion: 2.20 time: 0.236076 Jun 07 14:29:17.875111 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 372/777] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:17 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:18.816330 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-fdbb06c4-9ffc-4958-ae44-14e036e70398 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:18.816959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-fdbb06c4-9ffc-4958-ae44-14e036e70398 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] [instance: 2c161249-6227-4042-b88c-371e3e32503e] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:18.826793 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fdbb06c4-9ffc-4958-ae44-14e036e70398 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:18.828038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fdbb06c4-9ffc-4958-ae44-14e036e70398 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:18.828840 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fdbb06c4-9ffc-4958-ae44-14e036e70398 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:18.829288 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fdbb06c4-9ffc-4958-ae44-14e036e70398 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:18.833777 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:18.893204 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2cfadbbf-387c-4100-a88f-56bcb63d9995 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:18.893912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2cfadbbf-387c-4100-a88f-56bcb63d9995 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:18.911190 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2cfadbbf-387c-4100-a88f-56bcb63d9995 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:18.912211 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2cfadbbf-387c-4100-a88f-56bcb63d9995 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:18.913431 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2cfadbbf-387c-4100-a88f-56bcb63d9995 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:18.913873 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2cfadbbf-387c-4100-a88f-56bcb63d9995 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:19.090239 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-fdbb06c4-9ffc-4958-ae44-14e036e70398 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4185a7263943447a92a15571f192b0f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8cfd2bd8134c328696944b1913bc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:19.098015 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-fdbb06c4-9ffc-4958-ae44-14e036e70398 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] 10.222.0.81 "GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e" status: 200 len: 1315 microversion: 2.1 time: 0.285537 Jun 07 14:29:19.098913 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 406/778] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:18 2022] GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:19.149317 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2cfadbbf-387c-4100-a88f-56bcb63d9995 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:19.159902 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2cfadbbf-387c-4100-a88f-56bcb63d9995 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:19.161622 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-2cfadbbf-387c-4100-a88f-56bcb63d9995 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:19.163074 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2cfadbbf-387c-4100-a88f-56bcb63d9995 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1743 microversion: 2.20 time: 0.274544 Jun 07 14:29:19.164266 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 373/779] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:18 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1743 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:29:19.675125 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-b1c41c2d-5964-49ce-b1b7-8d18a9a133f0 req-32181f12-867f-47e6-b18d-b3fffacfe2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c161249-6227-4042-b88c-371e3e32503e", "tag": "902b955a-a58d-41f0-93ef-27fee7802ec1"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:29:19.707077 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-b1c41c2d-5964-49ce-b1b7-8d18a9a133f0 req-32181f12-867f-47e6-b18d-b3fffacfe2e0 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:19.708621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-b1c41c2d-5964-49ce-b1b7-8d18a9a133f0 req-32181f12-867f-47e6-b18d-b3fffacfe2e0 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:19.726685 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-b1c41c2d-5964-49ce-b1b7-8d18a9a133f0 req-32181f12-867f-47e6-b18d-b3fffacfe2e0 service nova] Creating event network-changed:902b955a-a58d-41f0-93ef-27fee7802ec1 for instance 2c161249-6227-4042-b88c-371e3e32503e on hv-cinder-83608 Jun 07 14:29:19.732645 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-b1c41c2d-5964-49ce-b1b7-8d18a9a133f0 req-32181f12-867f-47e6-b18d-b3fffacfe2e0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064254 Jun 07 14:29:19.735023 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 407/780] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:29:20.115199 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-156b4f64-a03e-480d-a0b3-8ec4e1beee6d tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:20.115833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-156b4f64-a03e-480d-a0b3-8ec4e1beee6d tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] [instance: 2c161249-6227-4042-b88c-371e3e32503e] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:20.122278 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-156b4f64-a03e-480d-a0b3-8ec4e1beee6d tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:20.122719 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-156b4f64-a03e-480d-a0b3-8ec4e1beee6d tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:20.123521 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-156b4f64-a03e-480d-a0b3-8ec4e1beee6d tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:20.124145 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-156b4f64-a03e-480d-a0b3-8ec4e1beee6d tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:20.182899 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-e972da4b-a68e-48dd-aa67-a10d32f50ce9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:20.184665 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-e972da4b-a68e-48dd-aa67-a10d32f50ce9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:20.191640 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e972da4b-a68e-48dd-aa67-a10d32f50ce9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:20.192109 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e972da4b-a68e-48dd-aa67-a10d32f50ce9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:20.192873 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e972da4b-a68e-48dd-aa67-a10d32f50ce9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:20.193307 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e972da4b-a68e-48dd-aa67-a10d32f50ce9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:20.286394 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-156b4f64-a03e-480d-a0b3-8ec4e1beee6d tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4185a7263943447a92a15571f192b0f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8cfd2bd8134c328696944b1913bc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:20.294058 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-156b4f64-a03e-480d-a0b3-8ec4e1beee6d tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] 10.222.0.81 "GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e" status: 200 len: 1315 microversion: 2.1 time: 0.182693 Jun 07 14:29:20.294627 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 374/781] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:20 2022] GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:20.341742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-e972da4b-a68e-48dd-aa67-a10d32f50ce9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:20.349645 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-e972da4b-a68e-48dd-aa67-a10d32f50ce9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:20.351141 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-e972da4b-a68e-48dd-aa67-a10d32f50ce9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:20.352323 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-e972da4b-a68e-48dd-aa67-a10d32f50ce9 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1743 microversion: 2.20 time: 0.174121 Jun 07 14:29:20.352877 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 408/782] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:20 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1743 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:29:21.310705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-570c498e-3c4d-41df-8d73-7868b41532e6 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:21.311952 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-570c498e-3c4d-41df-8d73-7868b41532e6 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] [instance: 2c161249-6227-4042-b88c-371e3e32503e] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:21.318683 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-570c498e-3c4d-41df-8d73-7868b41532e6 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:21.319135 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-570c498e-3c4d-41df-8d73-7868b41532e6 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:21.319941 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-570c498e-3c4d-41df-8d73-7868b41532e6 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:21.320381 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-570c498e-3c4d-41df-8d73-7868b41532e6 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:21.369890 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3157fe25-13b6-4950-9c7e-158ee5610e1e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:21.371437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-3157fe25-13b6-4950-9c7e-158ee5610e1e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:21.381484 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3157fe25-13b6-4950-9c7e-158ee5610e1e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:21.382238 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3157fe25-13b6-4950-9c7e-158ee5610e1e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:21.383207 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3157fe25-13b6-4950-9c7e-158ee5610e1e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:21.383888 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3157fe25-13b6-4950-9c7e-158ee5610e1e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:21.534388 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-570c498e-3c4d-41df-8d73-7868b41532e6 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4185a7263943447a92a15571f192b0f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8cfd2bd8134c328696944b1913bc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:21.548282 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-570c498e-3c4d-41df-8d73-7868b41532e6 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] 10.222.0.81 "GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e" status: 200 len: 1315 microversion: 2.1 time: 0.241176 Jun 07 14:29:21.559840 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 375/783] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:21 2022] GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:21.570857 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-3157fe25-13b6-4950-9c7e-158ee5610e1e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:21.580403 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-3157fe25-13b6-4950-9c7e-158ee5610e1e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:21.581917 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-3157fe25-13b6-4950-9c7e-158ee5610e1e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:21.583110 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-3157fe25-13b6-4950-9c7e-158ee5610e1e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1738 microversion: 2.20 time: 0.217271 Jun 07 14:29:21.583725 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 409/784] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:21 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:29:22.558869 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-d5fcef84-43ce-493a-abe6-a5afb941bc5a req-e0bc8bbf-0330-46e8-b11e-e6550f5ee0e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ed6c33-30a8-4a3b-aba5-57610c2ec718", "name": "network-vif-plugged", "status": "completed", "tag": "3f5b3dca-4f2b-407e-9796-9a5c5a344abb"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:29:22.567172 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-636c6632-58c7-44bc-b851-c1d639299fb2 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:22.568506 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-636c6632-58c7-44bc-b851-c1d639299fb2 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] [instance: 2c161249-6227-4042-b88c-371e3e32503e] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:22.586073 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-636c6632-58c7-44bc-b851-c1d639299fb2 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:22.587055 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-636c6632-58c7-44bc-b851-c1d639299fb2 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:22.589351 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-636c6632-58c7-44bc-b851-c1d639299fb2 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:22.589554 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-d5fcef84-43ce-493a-abe6-a5afb941bc5a req-e0bc8bbf-0330-46e8-b11e-e6550f5ee0e2 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:22.590656 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-636c6632-58c7-44bc-b851-c1d639299fb2 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:22.591173 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-d5fcef84-43ce-493a-abe6-a5afb941bc5a req-e0bc8bbf-0330-46e8-b11e-e6550f5ee0e2 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:22.635000 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=100 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:22.640622 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-d5fcef84-43ce-493a-abe6-a5afb941bc5a req-e0bc8bbf-0330-46e8-b11e-e6550f5ee0e2 service nova] Creating event network-vif-plugged:3f5b3dca-4f2b-407e-9796-9a5c5a344abb for instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718 on hv-cinder-83608 Jun 07 14:29:22.654395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-d5fcef84-43ce-493a-abe6-a5afb941bc5a req-e0bc8bbf-0330-46e8-b11e-e6550f5ee0e2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098320 Jun 07 14:29:22.659890 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 376/785] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:29:22.666525 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-67c91ab2-feaa-4990-9bd6-23da75941891 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:22.676109 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-67c91ab2-feaa-4990-9bd6-23da75941891 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:22.691937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-67c91ab2-feaa-4990-9bd6-23da75941891 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:22.692649 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-67c91ab2-feaa-4990-9bd6-23da75941891 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:22.693822 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-67c91ab2-feaa-4990-9bd6-23da75941891 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:22.694420 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-67c91ab2-feaa-4990-9bd6-23da75941891 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:22.868498 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-636c6632-58c7-44bc-b851-c1d639299fb2 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4185a7263943447a92a15571f192b0f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8cfd2bd8134c328696944b1913bc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:22.876712 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-636c6632-58c7-44bc-b851-c1d639299fb2 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] 10.222.0.81 "GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e" status: 200 len: 1315 microversion: 2.1 time: 0.313921 Jun 07 14:29:22.877946 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 410/786] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:22 2022] GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:22.925828 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-67c91ab2-feaa-4990-9bd6-23da75941891 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:22.934240 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-67c91ab2-feaa-4990-9bd6-23da75941891 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:22.936696 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-67c91ab2-feaa-4990-9bd6-23da75941891 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:22.938171 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-67c91ab2-feaa-4990-9bd6-23da75941891 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1738 microversion: 2.20 time: 0.276985 Jun 07 14:29:22.950012 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 377/787] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:22 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1738 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:23.901918 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-bd860d58-d008-4e98-ad59-58be0acf41da tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:23.902563 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-bd860d58-d008-4e98-ad59-58be0acf41da tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] [instance: 2c161249-6227-4042-b88c-371e3e32503e] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:23.910306 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bd860d58-d008-4e98-ad59-58be0acf41da tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:23.910755 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bd860d58-d008-4e98-ad59-58be0acf41da tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:23.911563 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bd860d58-d008-4e98-ad59-58be0acf41da tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:23.912205 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bd860d58-d008-4e98-ad59-58be0acf41da tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:23.958457 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b60e19bd-7481-4282-8846-4f9286bb13f6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:23.959057 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b60e19bd-7481-4282-8846-4f9286bb13f6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:23.966571 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b60e19bd-7481-4282-8846-4f9286bb13f6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:23.968623 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b60e19bd-7481-4282-8846-4f9286bb13f6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:23.969985 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b60e19bd-7481-4282-8846-4f9286bb13f6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:23.970673 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b60e19bd-7481-4282-8846-4f9286bb13f6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:24.167497 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-bd860d58-d008-4e98-ad59-58be0acf41da tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4185a7263943447a92a15571f192b0f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8cfd2bd8134c328696944b1913bc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:24.174936 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-bd860d58-d008-4e98-ad59-58be0acf41da tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] 10.222.0.81 "GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e" status: 200 len: 1315 microversion: 2.1 time: 0.276902 Jun 07 14:29:24.175622 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 411/788] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:23 2022] GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:24.208704 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b60e19bd-7481-4282-8846-4f9286bb13f6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:24.217731 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b60e19bd-7481-4282-8846-4f9286bb13f6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:24.219615 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b60e19bd-7481-4282-8846-4f9286bb13f6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:24.221153 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b60e19bd-7481-4282-8846-4f9286bb13f6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1738 microversion: 2.20 time: 0.266927 Jun 07 14:29:24.221724 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 378/789] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:23 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1738 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:29:25.192293 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-93829fd6-0073-42d6-beed-f586c6270350 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:25.193164 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-93829fd6-0073-42d6-beed-f586c6270350 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] [instance: 2c161249-6227-4042-b88c-371e3e32503e] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:25.204810 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-93829fd6-0073-42d6-beed-f586c6270350 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:25.205269 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-93829fd6-0073-42d6-beed-f586c6270350 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:25.206062 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-93829fd6-0073-42d6-beed-f586c6270350 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:25.206504 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-93829fd6-0073-42d6-beed-f586c6270350 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:25.241964 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5d316c22-5568-4951-8746-480d74771650 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:25.243735 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-5d316c22-5568-4951-8746-480d74771650 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:25.246116 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:25.257040 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5d316c22-5568-4951-8746-480d74771650 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:25.264086 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5d316c22-5568-4951-8746-480d74771650 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:25.265513 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5d316c22-5568-4951-8746-480d74771650 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:25.266207 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5d316c22-5568-4951-8746-480d74771650 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:25.479210 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-93829fd6-0073-42d6-beed-f586c6270350 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4185a7263943447a92a15571f192b0f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8cfd2bd8134c328696944b1913bc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:25.490192 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5d316c22-5568-4951-8746-480d74771650 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:25.493363 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-93829fd6-0073-42d6-beed-f586c6270350 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] 10.222.0.81 "GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e" status: 200 len: 1315 microversion: 2.1 time: 0.301457 Jun 07 14:29:25.494598 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 412/790] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:25 2022] GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:25.502485 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-366df58f-4745-4b8a-ac7d-bfcdebde9420 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:25.503403 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-366df58f-4745-4b8a-ac7d-bfcdebde9420 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:25.509543 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5d316c22-5568-4951-8746-480d74771650 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:25.511436 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5d316c22-5568-4951-8746-480d74771650 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:25.512841 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-5d316c22-5568-4951-8746-480d74771650 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1738 microversion: 2.20 time: 0.275603 Jun 07 14:29:25.513209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-366df58f-4745-4b8a-ac7d-bfcdebde9420 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:25.514108 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 379/791] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:25 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1738 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:25.514617 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-366df58f-4745-4b8a-ac7d-bfcdebde9420 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:25.515457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-366df58f-4745-4b8a-ac7d-bfcdebde9420 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:25.515903 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-366df58f-4745-4b8a-ac7d-bfcdebde9420 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:25.547032 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-366df58f-4745-4b8a-ac7d-bfcdebde9420 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Going to try to terminate instance {{(pid=117565) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:29:25.652437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-366df58f-4745-4b8a-ac7d-bfcdebde9420 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "DELETE /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141" status: 204 len: 0 microversion: 2.1 time: 0.156002 Jun 07 14:29:25.653256 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 413/792] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:29:25 2022] DELETE /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:29:25.663977 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9fecb38e-e16d-4968-9ae9-1a2a124485a9 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:25.664981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9fecb38e-e16d-4968-9ae9-1a2a124485a9 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:25.679250 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9fecb38e-e16d-4968-9ae9-1a2a124485a9 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:25.681495 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9fecb38e-e16d-4968-9ae9-1a2a124485a9 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:25.682355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9fecb38e-e16d-4968-9ae9-1a2a124485a9 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:25.682865 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9fecb38e-e16d-4968-9ae9-1a2a124485a9 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:25.841774 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9fecb38e-e16d-4968-9ae9-1a2a124485a9 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:25.853231 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9fecb38e-e16d-4968-9ae9-1a2a124485a9 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141" status: 200 len: 1577 microversion: 2.1 time: 0.193335 Jun 07 14:29:25.853811 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 380/793] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:25 2022] GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 => generated 1577 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:26.513141 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-fd91b323-16b5-4987-8855-1a1f2f31fafc tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:26.515527 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-fd91b323-16b5-4987-8855-1a1f2f31fafc tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] [instance: 2c161249-6227-4042-b88c-371e3e32503e] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:26.518427 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=2 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:26.532068 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-49df013f-1dd4-4b70-8128-d86046f2390c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:26.533379 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-49df013f-1dd4-4b70-8128-d86046f2390c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:26.538755 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fd91b323-16b5-4987-8855-1a1f2f31fafc tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:26.539246 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fd91b323-16b5-4987-8855-1a1f2f31fafc tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:26.540080 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fd91b323-16b5-4987-8855-1a1f2f31fafc tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:26.540518 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fd91b323-16b5-4987-8855-1a1f2f31fafc tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:26.545817 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-49df013f-1dd4-4b70-8128-d86046f2390c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:26.546904 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-49df013f-1dd4-4b70-8128-d86046f2390c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:26.550641 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-49df013f-1dd4-4b70-8128-d86046f2390c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:26.551270 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-49df013f-1dd4-4b70-8128-d86046f2390c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:26.627681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=8 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:26.743317 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-49df013f-1dd4-4b70-8128-d86046f2390c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:26.752286 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-49df013f-1dd4-4b70-8128-d86046f2390c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:26.753873 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-49df013f-1dd4-4b70-8128-d86046f2390c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:26.755468 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-49df013f-1dd4-4b70-8128-d86046f2390c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1738 microversion: 2.20 time: 0.227501 Jun 07 14:29:26.756122 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 381/794] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:26 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:26.771982 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-b316e2dc-9bb1-40db-b857-825a8ee56764 req-f02b1c49-cfb3-4407-9dab-a186cf648d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c161249-6227-4042-b88c-371e3e32503e", "name": "network-vif-plugged", "status": "completed", "tag": "902b955a-a58d-41f0-93ef-27fee7802ec1"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:29:26.781370 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-b316e2dc-9bb1-40db-b857-825a8ee56764 req-f02b1c49-cfb3-4407-9dab-a186cf648d40 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:26.782144 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-b316e2dc-9bb1-40db-b857-825a8ee56764 req-f02b1c49-cfb3-4407-9dab-a186cf648d40 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:26.794855 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-b316e2dc-9bb1-40db-b857-825a8ee56764 req-f02b1c49-cfb3-4407-9dab-a186cf648d40 service nova] Creating event network-vif-plugged:902b955a-a58d-41f0-93ef-27fee7802ec1 for instance 2c161249-6227-4042-b88c-371e3e32503e on hv-cinder-83608 Jun 07 14:29:26.802063 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-b316e2dc-9bb1-40db-b857-825a8ee56764 req-f02b1c49-cfb3-4407-9dab-a186cf648d40 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033642 Jun 07 14:29:26.802940 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 382/795] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:29:26.857132 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-fd91b323-16b5-4987-8855-1a1f2f31fafc tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4185a7263943447a92a15571f192b0f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8cfd2bd8134c328696944b1913bc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:26.867705 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-fd91b323-16b5-4987-8855-1a1f2f31fafc tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] 10.222.0.81 "GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e" status: 200 len: 1315 microversion: 2.1 time: 0.360288 Jun 07 14:29:26.869086 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 414/796] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:26 2022] GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:26.883206 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ec4a3916-cf78-4b2e-b380-cf7c246a93e7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:26.884196 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ec4a3916-cf78-4b2e-b380-cf7c246a93e7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:26.892790 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ec4a3916-cf78-4b2e-b380-cf7c246a93e7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:26.893468 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ec4a3916-cf78-4b2e-b380-cf7c246a93e7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:26.894436 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ec4a3916-cf78-4b2e-b380-cf7c246a93e7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:26.895046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ec4a3916-cf78-4b2e-b380-cf7c246a93e7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:27.086171 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ec4a3916-cf78-4b2e-b380-cf7c246a93e7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:27.097702 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ec4a3916-cf78-4b2e-b380-cf7c246a93e7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141" status: 200 len: 1577 microversion: 2.1 time: 0.229870 Jun 07 14:29:27.098766 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 383/797] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:26 2022] GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 => generated 1577 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:27.774315 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-4e8a9620-decb-499a-adb6-7d8a77fd31e7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:27.775089 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-4e8a9620-decb-499a-adb6-7d8a77fd31e7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:27.777509 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:27.787286 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4e8a9620-decb-499a-adb6-7d8a77fd31e7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:27.788338 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4e8a9620-decb-499a-adb6-7d8a77fd31e7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:27.789348 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4e8a9620-decb-499a-adb6-7d8a77fd31e7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:27.789941 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4e8a9620-decb-499a-adb6-7d8a77fd31e7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:27.911002 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e8ba6410-3d9c-4138-b798-8c855bf028cb tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:27.912320 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e8ba6410-3d9c-4138-b798-8c855bf028cb tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] [instance: 2c161249-6227-4042-b88c-371e3e32503e] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:27.922790 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e8ba6410-3d9c-4138-b798-8c855bf028cb tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:27.923540 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e8ba6410-3d9c-4138-b798-8c855bf028cb tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:27.924847 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e8ba6410-3d9c-4138-b798-8c855bf028cb tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:27.925484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e8ba6410-3d9c-4138-b798-8c855bf028cb tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:28.112691 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-4e8a9620-decb-499a-adb6-7d8a77fd31e7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:28.121394 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-4e8a9620-decb-499a-adb6-7d8a77fd31e7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:28.123145 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-4e8a9620-decb-499a-adb6-7d8a77fd31e7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:28.125398 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-4e8a9620-decb-499a-adb6-7d8a77fd31e7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1738 microversion: 2.20 time: 0.355336 Jun 07 14:29:28.126471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 415/798] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:27 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1738 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:28.131075 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3dd022ad-06be-44b0-8fa4-99c567299efa tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:28.131909 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-3dd022ad-06be-44b0-8fa4-99c567299efa tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:28.143043 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3dd022ad-06be-44b0-8fa4-99c567299efa tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:28.143765 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3dd022ad-06be-44b0-8fa4-99c567299efa tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:28.146708 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3dd022ad-06be-44b0-8fa4-99c567299efa tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:28.147470 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3dd022ad-06be-44b0-8fa4-99c567299efa tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:28.381687 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e8ba6410-3d9c-4138-b798-8c855bf028cb tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4185a7263943447a92a15571f192b0f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8cfd2bd8134c328696944b1913bc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:28.393601 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e8ba6410-3d9c-4138-b798-8c855bf028cb tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] 10.222.0.81 "GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e" status: 200 len: 1315 microversion: 2.1 time: 0.506986 Jun 07 14:29:28.395735 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 384/799] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:27 2022] GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:28.448705 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-3dd022ad-06be-44b0-8fa4-99c567299efa tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:28.459237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-3dd022ad-06be-44b0-8fa4-99c567299efa tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141" status: 200 len: 1577 microversion: 2.1 time: 0.331517 Jun 07 14:29:28.469947 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 416/800] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:28 2022] GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 => generated 1577 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:28.887464 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-dacaa999-e1b6-4d28-b6af-48b1282d15f5 req-02ed8bbd-090a-4620-aa0f-3d3176a7c0cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99bfe151-4396-4c86-9fb5-f26989972141", "name": "network-vif-deleted", "tag": "cf62c8e3-d8c3-4512-a430-f4144559869d"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:29:28.918546 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-dacaa999-e1b6-4d28-b6af-48b1282d15f5 req-02ed8bbd-090a-4620-aa0f-3d3176a7c0cc service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:28.919168 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-dacaa999-e1b6-4d28-b6af-48b1282d15f5 req-02ed8bbd-090a-4620-aa0f-3d3176a7c0cc service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:28.946304 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-dacaa999-e1b6-4d28-b6af-48b1282d15f5 req-02ed8bbd-090a-4620-aa0f-3d3176a7c0cc service nova] Creating event network-vif-deleted:cf62c8e3-d8c3-4512-a430-f4144559869d for instance 99bfe151-4396-4c86-9fb5-f26989972141 on hv-cinder-83608 Jun 07 14:29:28.958718 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-dacaa999-e1b6-4d28-b6af-48b1282d15f5 req-02ed8bbd-090a-4620-aa0f-3d3176a7c0cc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077098 Jun 07 14:29:28.963172 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 385/801] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:29:29.145529 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-573b6a9b-706b-43c7-86b2-57e20b2c848f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:29.149754 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-573b6a9b-706b-43c7-86b2-57e20b2c848f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:29.192669 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-573b6a9b-706b-43c7-86b2-57e20b2c848f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:29.193078 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-573b6a9b-706b-43c7-86b2-57e20b2c848f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:29.196555 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-573b6a9b-706b-43c7-86b2-57e20b2c848f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:29.197043 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-573b6a9b-706b-43c7-86b2-57e20b2c848f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:29.413030 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8bf3251e-41c4-4911-b28e-1827c4e1df85 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:29.414753 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8bf3251e-41c4-4911-b28e-1827c4e1df85 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] [instance: 2c161249-6227-4042-b88c-371e3e32503e] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:29.425819 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8bf3251e-41c4-4911-b28e-1827c4e1df85 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:29.426592 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8bf3251e-41c4-4911-b28e-1827c4e1df85 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:29.428214 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8bf3251e-41c4-4911-b28e-1827c4e1df85 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:29.428854 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8bf3251e-41c4-4911-b28e-1827c4e1df85 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:29.432728 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-573b6a9b-706b-43c7-86b2-57e20b2c848f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:29.444088 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-573b6a9b-706b-43c7-86b2-57e20b2c848f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:29.445644 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-573b6a9b-706b-43c7-86b2-57e20b2c848f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:29.446831 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-573b6a9b-706b-43c7-86b2-57e20b2c848f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1738 microversion: 2.20 time: 0.306606 Jun 07 14:29:29.455269 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 417/802] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:29 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1738 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:29:29.488107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ad79500e-ce51-4336-8ad4-ae47051ab6d7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:29.488779 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ad79500e-ce51-4336-8ad4-ae47051ab6d7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:29.512001 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ad79500e-ce51-4336-8ad4-ae47051ab6d7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:29.512657 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ad79500e-ce51-4336-8ad4-ae47051ab6d7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:29.513642 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ad79500e-ce51-4336-8ad4-ae47051ab6d7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:29.515000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ad79500e-ce51-4336-8ad4-ae47051ab6d7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:29.564665 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ad79500e-ce51-4336-8ad4-ae47051ab6d7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:29.565431 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ad79500e-ce51-4336-8ad4-ae47051ab6d7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:29.566238 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.objects.instance [None req-ad79500e-ce51-4336-8ad4-ae47051ab6d7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lazy-loading 'fault' on Instance uuid 99bfe151-4396-4c86-9fb5-f26989972141 {{(pid=117565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:29:29.630002 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ad79500e-ce51-4336-8ad4-ae47051ab6d7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:29.638936 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ad79500e-ce51-4336-8ad4-ae47051ab6d7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141" status: 200 len: 1230 microversion: 2.1 time: 0.165484 Jun 07 14:29:29.649891 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 418/803] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:29 2022] GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 => generated 1230 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:29:29.657012 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8bf3251e-41c4-4911-b28e-1827c4e1df85 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4185a7263943447a92a15571f192b0f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8cfd2bd8134c328696944b1913bc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:29.664655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8bf3251e-41c4-4911-b28e-1827c4e1df85 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] 10.222.0.81 "GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e" status: 200 len: 1464 microversion: 2.1 time: 0.255332 Jun 07 14:29:29.688876 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 386/804] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:29 2022] GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e => generated 1464 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:29.705581 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-06b76908-9d21-4503-a66a-ffef879718aa tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:29.707178 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-06b76908-9d21-4503-a66a-ffef879718aa tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] [instance: 2c161249-6227-4042-b88c-371e3e32503e] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:29.713793 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-06b76908-9d21-4503-a66a-ffef879718aa tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:29.714360 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-06b76908-9d21-4503-a66a-ffef879718aa tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:29.715993 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-06b76908-9d21-4503-a66a-ffef879718aa tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:29.715993 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-06b76908-9d21-4503-a66a-ffef879718aa tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:29.743616 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-06b76908-9d21-4503-a66a-ffef879718aa tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] [instance: 2c161249-6227-4042-b88c-371e3e32503e] Going to try to terminate instance {{(pid=117565) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:29:29.803635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:29.840493 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-06b76908-9d21-4503-a66a-ffef879718aa tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] 10.222.0.81 "DELETE /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e" status: 204 len: 0 microversion: 2.1 time: 0.138212 Jun 07 14:29:29.841619 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 419/805] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:29:29 2022] DELETE /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:29:29.850850 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ef28130b-8baf-4875-8ec5-f5d81df2ee91 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:29.851784 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ef28130b-8baf-4875-8ec5-f5d81df2ee91 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] [instance: 2c161249-6227-4042-b88c-371e3e32503e] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:29.860737 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ef28130b-8baf-4875-8ec5-f5d81df2ee91 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:29.861422 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ef28130b-8baf-4875-8ec5-f5d81df2ee91 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:29.862364 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ef28130b-8baf-4875-8ec5-f5d81df2ee91 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:29.862956 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ef28130b-8baf-4875-8ec5-f5d81df2ee91 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:30.039084 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ef28130b-8baf-4875-8ec5-f5d81df2ee91 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4185a7263943447a92a15571f192b0f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8cfd2bd8134c328696944b1913bc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:30.055590 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ef28130b-8baf-4875-8ec5-f5d81df2ee91 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] 10.222.0.81 "GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e" status: 200 len: 1470 microversion: 2.1 time: 0.208666 Jun 07 14:29:30.056744 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 387/806] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:29 2022] GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e => generated 1470 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:30.469496 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-be6b6616-eb35-41bc-9cfe-5e3fdd592fd1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:30.470287 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-be6b6616-eb35-41bc-9cfe-5e3fdd592fd1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:30.477125 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-be6b6616-eb35-41bc-9cfe-5e3fdd592fd1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:30.477682 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-be6b6616-eb35-41bc-9cfe-5e3fdd592fd1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:30.478678 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-be6b6616-eb35-41bc-9cfe-5e3fdd592fd1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:30.479228 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-be6b6616-eb35-41bc-9cfe-5e3fdd592fd1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:30.646026 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-be6b6616-eb35-41bc-9cfe-5e3fdd592fd1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:30.655574 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-be6b6616-eb35-41bc-9cfe-5e3fdd592fd1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:30.656384 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-12628811-1c87-4149-9d95-bdcf2bd80a3a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:30.657002 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-12628811-1c87-4149-9d95-bdcf2bd80a3a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:30.657143 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-be6b6616-eb35-41bc-9cfe-5e3fdd592fd1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:30.658267 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-be6b6616-eb35-41bc-9cfe-5e3fdd592fd1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1738 microversion: 2.20 time: 0.194148 Jun 07 14:29:30.659139 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 420/807] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:30 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:29:30.673508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-12628811-1c87-4149-9d95-bdcf2bd80a3a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:30.674218 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-12628811-1c87-4149-9d95-bdcf2bd80a3a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:30.675178 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-12628811-1c87-4149-9d95-bdcf2bd80a3a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:30.675901 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-12628811-1c87-4149-9d95-bdcf2bd80a3a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:30.709850 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-12628811-1c87-4149-9d95-bdcf2bd80a3a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:30.710298 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-12628811-1c87-4149-9d95-bdcf2bd80a3a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:30.710749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-12628811-1c87-4149-9d95-bdcf2bd80a3a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lazy-loading 'fault' on Instance uuid 99bfe151-4396-4c86-9fb5-f26989972141 {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:29:30.756655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-12628811-1c87-4149-9d95-bdcf2bd80a3a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:30.764987 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-12628811-1c87-4149-9d95-bdcf2bd80a3a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141" status: 200 len: 1230 microversion: 2.1 time: 0.112760 Jun 07 14:29:30.775031 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 388/808] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:30 2022] GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 => generated 1230 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:29:31.073193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-63667f19-0168-4df0-9b2f-45560b2a4799 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:31.073980 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-63667f19-0168-4df0-9b2f-45560b2a4799 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] [instance: 2c161249-6227-4042-b88c-371e3e32503e] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:31.080422 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-63667f19-0168-4df0-9b2f-45560b2a4799 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:31.080958 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-63667f19-0168-4df0-9b2f-45560b2a4799 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:31.081846 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-63667f19-0168-4df0-9b2f-45560b2a4799 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:31.082354 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-63667f19-0168-4df0-9b2f-45560b2a4799 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:31.224680 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-63667f19-0168-4df0-9b2f-45560b2a4799 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4185a7263943447a92a15571f192b0f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8cfd2bd8134c328696944b1913bc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:31.232150 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-63667f19-0168-4df0-9b2f-45560b2a4799 tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] 10.222.0.81 "GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e" status: 200 len: 1470 microversion: 2.1 time: 0.162840 Jun 07 14:29:31.233561 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 421/809] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:31 2022] GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:31.676357 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-34d79230-6404-4781-b1eb-2c0087c44843 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:31.676987 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-34d79230-6404-4781-b1eb-2c0087c44843 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:31.687210 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-34d79230-6404-4781-b1eb-2c0087c44843 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:31.687911 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-34d79230-6404-4781-b1eb-2c0087c44843 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:31.688717 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-34d79230-6404-4781-b1eb-2c0087c44843 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:31.689161 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-34d79230-6404-4781-b1eb-2c0087c44843 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:31.720974 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-f9396143-bbe4-40a5-b8a1-a3548408e00c req-dcdc9903-5ddc-4aa4-8327-80e5064eefaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c161249-6227-4042-b88c-371e3e32503e", "name": "network-vif-deleted", "tag": "902b955a-a58d-41f0-93ef-27fee7802ec1"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:29:31.729875 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-f9396143-bbe4-40a5-b8a1-a3548408e00c req-dcdc9903-5ddc-4aa4-8327-80e5064eefaa service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:31.733631 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-f9396143-bbe4-40a5-b8a1-a3548408e00c req-dcdc9903-5ddc-4aa4-8327-80e5064eefaa service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:31.751573 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-f9396143-bbe4-40a5-b8a1-a3548408e00c req-dcdc9903-5ddc-4aa4-8327-80e5064eefaa service nova] Creating event network-vif-deleted:902b955a-a58d-41f0-93ef-27fee7802ec1 for instance 2c161249-6227-4042-b88c-371e3e32503e on hv-cinder-83608 Jun 07 14:29:31.757611 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-f9396143-bbe4-40a5-b8a1-a3548408e00c req-dcdc9903-5ddc-4aa4-8327-80e5064eefaa service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040502 Jun 07 14:29:31.759384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 422/810] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:29:31.788227 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-2382fb0e-0a9a-45a0-84ec-c596e08efac7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:31.788971 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-2382fb0e-0a9a-45a0-84ec-c596e08efac7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:31.807063 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2382fb0e-0a9a-45a0-84ec-c596e08efac7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:31.807708 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2382fb0e-0a9a-45a0-84ec-c596e08efac7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:31.808505 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2382fb0e-0a9a-45a0-84ec-c596e08efac7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:31.808959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2382fb0e-0a9a-45a0-84ec-c596e08efac7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:31.830154 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-2382fb0e-0a9a-45a0-84ec-c596e08efac7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] HTTP exception thrown: Instance 99bfe151-4396-4c86-9fb5-f26989972141 could not be found. Jun 07 14:29:31.831892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-2382fb0e-0a9a-45a0-84ec-c596e08efac7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Request method failure captured: Jun 07 14:29:31.831892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 HTTP/1.1 Jun 07 14:29:31.831892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:29:31.831892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:29:31.831892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:29:31.831892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:29:31.831892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:29:31.831892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:29:31.831892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:29:31.831892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:29:31.831892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin2AYcIQp1UpZVWAvyl38WaYCMNW3yjqYupSPwUfIEV0pMBdPDiO_POFxBAdNlwjmzA2RngwAWba1QMnW_xcFiA5EZ-2A6ENxJn9QaSyZDrNkVISRAUmdwhDLHuJAaj_1uLen5V_B-mA2IM_0EGQmmCwNPaptfv3uQR27LdUirZHoB5k Jun 07 14:29:31.831892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:29:31.831892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:29:31.831892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:29:31.831892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:29:31.831892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:29:31.831892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:29:31.831892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: 6ee52855d08e467f9d2f02685d7bf541 Jun 07 14:29:31.831892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-TestVolumeBootPattern-1981564424 Jun 07 14:29:31.831892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:29:31.831892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:29:31.833410 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6ee52855d08e467f9d2f02685d7bf541"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6ee52855d08e467f9d2f02685d7bf541", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6ee52855d08e467f9d2f02685d7bf541"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6ee52855d08e467f9d2f02685d7bf541"}]}] Jun 07 14:29:31.833410 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-TestVolumeBootPattern-1981564424 Jun 07 14:29:31.833410 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: 6ee52855d08e467f9d2f02685d7bf541 Jun 07 14:29:31.833410 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-TestVolumeBootPattern-1981564424 Jun 07 14:29:31.833410 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-TestVolumeBootPattern-1981564424-project Jun 07 14:29:31.833410 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:29:31.833410 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:29:31.833410 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: d0b828a3dca14f2283a16894364d6eef Jun 07 14:29:31.833410 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-TestVolumeBootPattern-1981564424-project Jun 07 14:29:31.833410 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:29:31.833410 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance 99bfe151-4396-4c86-9fb5-f26989972141 could not be found. Jun 07 14:29:31.833410 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': '99bfe151-4396-4c86-9fb5-f26989972141'} Jun 07 14:29:31.834370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:29:31.834370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:29:31.834370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:29:31.834370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:29:31.834370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:29:31.834370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:29:31.834370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:29:31.834370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:29:31.834370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:29:31.834370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:29:31.834370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99bfe151-4396-4c86-9fb5-f26989972141 could not be found. Jun 07 14:29:31.834370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:29:31.834370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:29:31.834370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:29:31.834370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:29:31.834370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:29:31.834370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:29:31.834370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:29:31.834370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:29:31.834370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:29:31.835992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:29:31.835992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:29:31.835992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:29:31.835992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:29:31.835992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:29:31.835992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:29:31.835992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:29:31.835992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99bfe151-4396-4c86-9fb5-f26989972141 could not be found. Jun 07 14:29:31.835992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:29:31.835992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:29:31.835992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:29:31.835992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:29:31.835992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:29:31.835992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:29:31.835992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:29:31.835992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:29:31.835992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99bfe151-4396-4c86-9fb5-f26989972141 could not be found. Jun 07 14:29:31.835992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:29:31.837292 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-2382fb0e-0a9a-45a0-84ec-c596e08efac7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Returning 404 to user: Instance 99bfe151-4396-4c86-9fb5-f26989972141 could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:29:31.837292 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-2382fb0e-0a9a-45a0-84ec-c596e08efac7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141" status: 404 len: 111 microversion: 2.1 time: 0.054191 Jun 07 14:29:31.841950 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 423/811] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:31 2022] GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 14:29:31.876123 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-34d79230-6404-4781-b1eb-2c0087c44843 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:31.885506 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-34d79230-6404-4781-b1eb-2c0087c44843 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:31.887392 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-34d79230-6404-4781-b1eb-2c0087c44843 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:31.889141 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-34d79230-6404-4781-b1eb-2c0087c44843 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1738 microversion: 2.20 time: 0.216465 Jun 07 14:29:31.903741 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 389/812] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:31 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:31.960321 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-2865d11f-515f-4d36-9097-e9301e9c5daf tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1334350221", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-234910173", "security_groups": [{"name": "tempest-secgroup-smoke-1262891354"}], "block_device_mapping_v2": [{"uuid": "a19f11df-e181-473c-a5b7-bd25be733238", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2c006233-0519-428c-b750-6c5e4d46a20e"}]}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:29:32.075777 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.network.neutron [None req-2865d11f-515f-4d36-9097-e9301e9c5daf tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] validate_networks() for [('2c006233-0519-428c-b750-6c5e4d46a20e', None, None, None, None, None)] {{(pid=117565) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:29:32.253452 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-638a4819-7922-42fd-8a6f-7d43d0ffc62f tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:32.254340 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-638a4819-7922-42fd-8a6f-7d43d0ffc62f tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] [instance: 2c161249-6227-4042-b88c-371e3e32503e] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:32.263363 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-638a4819-7922-42fd-8a6f-7d43d0ffc62f tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:32.263858 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-638a4819-7922-42fd-8a6f-7d43d0ffc62f tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:32.265164 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-638a4819-7922-42fd-8a6f-7d43d0ffc62f tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:32.265609 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-638a4819-7922-42fd-8a6f-7d43d0ffc62f tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:32.280825 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-638a4819-7922-42fd-8a6f-7d43d0ffc62f tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] HTTP exception thrown: Instance 2c161249-6227-4042-b88c-371e3e32503e could not be found. Jun 07 14:29:32.282880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-638a4819-7922-42fd-8a6f-7d43d0ffc62f tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Request method failure captured: Jun 07 14:29:32.282880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e HTTP/1.1 Jun 07 14:29:32.282880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 07 14:29:32.282880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 07 14:29:32.282880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Connection: close Jun 07 14:29:32.282880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 07 14:29:32.282880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 07 14:29:32.282880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Host: 10.222.0.81 Jun 07 14:29:32.282880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 07 14:29:32.282880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 07 14:29:32.282880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABin2C6OrBCVxMHvrA0Kk-AWkG7FggVDt3UVH36xeK9atNCLjYxQ_Rw2zML8ChAtm20c9YHb54TT-WEv6HWyb9IxvVhfOZQBSCLfSuvRfamlEmuGnmE-YChTxD7nSz-5zvHHQ61atHOUOBkiZl3XKGDNvvwbgPLH9-4oyV_hrv3NkjgIFM Jun 07 14:29:32.282880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 07 14:29:32.282880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 07 14:29:32.282880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 07 14:29:32.282880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 07 14:29:32.282880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 07 14:29:32.282880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 07 14:29:32.282880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Id: 6e8cfd2bd8134c328696944b1913bc41 Jun 07 14:29:32.282880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-VolumesNegativeTest-2065487967 Jun 07 14:29:32.282880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Role: member,reader Jun 07 14:29:32.282880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Roles: member,reader Jun 07 14:29:32.284797 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6e8cfd2bd8134c328696944b1913bc41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6e8cfd2bd8134c328696944b1913bc41", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6e8cfd2bd8134c328696944b1913bc41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6e8cfd2bd8134c328696944b1913bc41"}]}] Jun 07 14:29:32.284797 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-VolumesNegativeTest-2065487967 Jun 07 14:29:32.284797 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 6e8cfd2bd8134c328696944b1913bc41 Jun 07 14:29:32.284797 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-VolumesNegativeTest-2065487967 Jun 07 14:29:32.284797 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User: tempest-VolumesNegativeTest-2065487967-project Jun 07 14:29:32.284797 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 07 14:29:32.284797 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 07 14:29:32.284797 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Id: 4185a7263943447a92a15571f192b0f8 Jun 07 14:29:32.284797 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-VolumesNegativeTest-2065487967-project Jun 07 14:29:32.284797 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: method: > Jun 07 14:29:32.284797 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: exception: Instance 2c161249-6227-4042-b88c-371e3e32503e could not be found. Jun 07 14:29:32.284797 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: action_args: {'id': '2c161249-6227-4042-b88c-371e3e32503e'} Jun 07 14:29:32.285685 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:29:32.285685 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:29:32.285685 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:29:32.285685 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:29:32.285685 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:29:32.285685 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:29:32.285685 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:29:32.285685 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:29:32.285685 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:29:32.285685 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:29:32.285685 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c161249-6227-4042-b88c-371e3e32503e could not be found. Jun 07 14:29:32.285685 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:29:32.285685 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:29:32.285685 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:29:32.285685 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:29:32.285685 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:29:32.285685 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:29:32.285685 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:29:32.285685 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:29:32.285685 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:29:32.286879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:29:32.286879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:29:32.286879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:29:32.286879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:29:32.286879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:29:32.286879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:29:32.286879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:29:32.286879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c161249-6227-4042-b88c-371e3e32503e could not be found. Jun 07 14:29:32.286879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:29:32.286879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:29:32.286879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:29:32.286879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:29:32.286879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:29:32.286879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:29:32.286879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:29:32.286879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:29:32.286879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c161249-6227-4042-b88c-371e3e32503e could not be found. Jun 07 14:29:32.286879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:29:32.287996 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-638a4819-7922-42fd-8a6f-7d43d0ffc62f tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] Returning 404 to user: Instance 2c161249-6227-4042-b88c-371e3e32503e could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:29:32.287996 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-638a4819-7922-42fd-8a6f-7d43d0ffc62f tempest-VolumesNegativeTest-2065487967 tempest-VolumesNegativeTest-2065487967-project] 10.222.0.81 "GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e" status: 404 len: 111 microversion: 2.1 time: 0.036403 Jun 07 14:29:32.290813 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 390/813] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:32 2022] GET /compute/v2.1/servers/2c161249-6227-4042-b88c-371e3e32503e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 14:29:32.911859 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-fecb9f3b-7e3e-4657-bf88-c8bb1c0c7fa5 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:32.912686 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-fecb9f3b-7e3e-4657-bf88-c8bb1c0c7fa5 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:32.919899 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fecb9f3b-7e3e-4657-bf88-c8bb1c0c7fa5 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:32.920589 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fecb9f3b-7e3e-4657-bf88-c8bb1c0c7fa5 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:32.921605 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fecb9f3b-7e3e-4657-bf88-c8bb1c0c7fa5 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:32.922210 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fecb9f3b-7e3e-4657-bf88-c8bb1c0c7fa5 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:33.090289 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-2865d11f-515f-4d36-9097-e9301e9c5daf tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Flavor limits 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:29:33.091411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-2865d11f-515f-4d36-9097-e9301e9c5daf tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Image limits 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:29:33.092949 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-2865d11f-515f-4d36-9097-e9301e9c5daf tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Flavor pref 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:29:33.093357 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-2865d11f-515f-4d36-9097-e9301e9c5daf tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Image pref 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:29:33.093785 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-2865d11f-515f-4d36-9097-e9301e9c5daf tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:29:33.102875 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2865d11f-515f-4d36-9097-e9301e9c5daf tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:33.103365 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2865d11f-515f-4d36-9097-e9301e9c5daf tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:33.104146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2865d11f-515f-4d36-9097-e9301e9c5daf tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:33.104585 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-2865d11f-515f-4d36-9097-e9301e9c5daf tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:33.122911 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-2865d11f-515f-4d36-9097-e9301e9c5daf tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Getting quotas for project 6ee52855d08e467f9d2f02685d7bf541. Resources: {'ram', 'cores', 'instances'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:29:33.127895 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-2865d11f-515f-4d36-9097-e9301e9c5daf tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Getting quotas for user d0b828a3dca14f2283a16894364d6eef and project 6ee52855d08e467f9d2f02685d7bf541. Resources: {'ram', 'cores', 'instances'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:29:33.137315 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-fecb9f3b-7e3e-4657-bf88-c8bb1c0c7fa5 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:33.149102 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-fecb9f3b-7e3e-4657-bf88-c8bb1c0c7fa5 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:33.151557 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-fecb9f3b-7e3e-4657-bf88-c8bb1c0c7fa5 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:33.152983 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-fecb9f3b-7e3e-4657-bf88-c8bb1c0c7fa5 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1720 microversion: 2.20 time: 0.245109 Jun 07 14:29:33.153621 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 391/814] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:32 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1720 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:29:33.209018 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-2865d11f-515f-4d36-9097-e9301e9c5daf tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Going to run 1 instances... {{(pid=117565) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:29:33.211099 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-2865d11f-515f-4d36-9097-e9301e9c5daf tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a19f11df-e181-473c-a5b7-bd25be733238',volume_size=None,volume_type=None)] {{(pid=117565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:29:33.347652 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-2865d11f-515f-4d36-9097-e9301e9c5daf tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.391374 Jun 07 14:29:33.348559 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 424/815] 10.222.0.81 () {60 vars in 1146 bytes} [Tue Jun 7 14:29:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:29:33.359560 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-4e1568cf-25ca-4047-a4da-9290f2051784 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:33.360234 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-4e1568cf-25ca-4047-a4da-9290f2051784 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:33.423085 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-4e1568cf-25ca-4047-a4da-9290f2051784 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:33.430336 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-4e1568cf-25ca-4047-a4da-9290f2051784 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 200 len: 1094 microversion: 2.1 time: 0.075595 Jun 07 14:29:33.430907 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 392/816] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:33 2022] GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:34.173087 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-e5832727-0804-44f4-9a63-a24415a88885 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:34.173704 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-e5832727-0804-44f4-9a63-a24415a88885 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:34.180226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e5832727-0804-44f4-9a63-a24415a88885 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:34.180676 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e5832727-0804-44f4-9a63-a24415a88885 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:34.181441 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e5832727-0804-44f4-9a63-a24415a88885 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:34.181875 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e5832727-0804-44f4-9a63-a24415a88885 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:34.313721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-e5832727-0804-44f4-9a63-a24415a88885 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:34.321921 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-e5832727-0804-44f4-9a63-a24415a88885 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:34.323599 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-e5832727-0804-44f4-9a63-a24415a88885 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:34.324803 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-e5832727-0804-44f4-9a63-a24415a88885 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1720 microversion: 2.20 time: 0.156988 Jun 07 14:29:34.325350 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 425/817] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:34 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:34.447118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-baa22aff-9db9-4200-b423-75617061fa01 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:34.447781 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-baa22aff-9db9-4200-b423-75617061fa01 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:34.454520 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-baa22aff-9db9-4200-b423-75617061fa01 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:34.454978 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-baa22aff-9db9-4200-b423-75617061fa01 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:34.455777 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-baa22aff-9db9-4200-b423-75617061fa01 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:34.456217 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-baa22aff-9db9-4200-b423-75617061fa01 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:34.523375 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-baa22aff-9db9-4200-b423-75617061fa01 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:34.531636 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-baa22aff-9db9-4200-b423-75617061fa01 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 200 len: 1144 microversion: 2.1 time: 0.088255 Jun 07 14:29:34.532080 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 393/818] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:34 2022] GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:35.343197 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d969d195-654e-4cc3-864b-0e3fa24728fc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:35.344183 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-d969d195-654e-4cc3-864b-0e3fa24728fc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:35.351944 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d969d195-654e-4cc3-864b-0e3fa24728fc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:35.352679 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d969d195-654e-4cc3-864b-0e3fa24728fc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:35.353707 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d969d195-654e-4cc3-864b-0e3fa24728fc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:35.354190 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d969d195-654e-4cc3-864b-0e3fa24728fc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:35.549053 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-15a5777f-9f0f-4838-8db6-897149f007fa tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:35.549643 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-15a5777f-9f0f-4838-8db6-897149f007fa tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:35.556958 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-15a5777f-9f0f-4838-8db6-897149f007fa tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:35.557493 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-15a5777f-9f0f-4838-8db6-897149f007fa tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:35.558343 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-15a5777f-9f0f-4838-8db6-897149f007fa tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:35.559003 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-15a5777f-9f0f-4838-8db6-897149f007fa tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:35.590293 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-d969d195-654e-4cc3-864b-0e3fa24728fc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:35.598545 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-d969d195-654e-4cc3-864b-0e3fa24728fc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:35.600196 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-d969d195-654e-4cc3-864b-0e3fa24728fc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:35.601435 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-d969d195-654e-4cc3-864b-0e3fa24728fc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1663 microversion: 2.20 time: 0.263183 Jun 07 14:29:35.602142 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 426/819] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:35 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1663 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:35.619901 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-9d060ac4-71ba-42b9-98b1-062c50e872cd tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95ecc405-35d2-458a-a5b2-f2b9765c0ecf"}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:29:35.621108 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-9d060ac4-71ba-42b9-98b1-062c50e872cd tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:35.628269 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9d060ac4-71ba-42b9-98b1-062c50e872cd tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:35.628829 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9d060ac4-71ba-42b9-98b1-062c50e872cd tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:35.629755 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9d060ac4-71ba-42b9-98b1-062c50e872cd tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:35.630204 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9d060ac4-71ba-42b9-98b1-062c50e872cd tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:35.635161 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-15a5777f-9f0f-4838-8db6-897149f007fa tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:35.644271 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-15a5777f-9f0f-4838-8db6-897149f007fa tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 200 len: 1210 microversion: 2.1 time: 0.099863 Jun 07 14:29:35.655410 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 394/820] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:35 2022] GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 1210 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:35.941729 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-9d060ac4-71ba-42b9-98b1-062c50e872cd tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "POST /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.325656 Jun 07 14:29:35.943291 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 427/821] 10.222.0.81 () {62 vars in 1363 bytes} [Tue Jun 7 14:29:35 2022] POST /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718/os-volume_attachments => generated 188 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 14:29:36.076873 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-790a8f8b-dbd0-4492-b80f-2bd466ab4410 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:29:36.077580 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-790a8f8b-dbd0-4492-b80f-2bd466ab4410 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:36.083822 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-790a8f8b-dbd0-4492-b80f-2bd466ab4410 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:36.084672 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-790a8f8b-dbd0-4492-b80f-2bd466ab4410 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:36.085571 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-790a8f8b-dbd0-4492-b80f-2bd466ab4410 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:36.086095 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-790a8f8b-dbd0-4492-b80f-2bd466ab4410 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:36.162667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=100 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:36.204451 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-790a8f8b-dbd0-4492-b80f-2bd466ab4410 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "POST /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718/action" status: 202 len: 0 microversion: 2.20 time: 0.131595 Jun 07 14:29:36.204976 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 395/822] 10.222.0.81 () {62 vars in 1318 bytes} [Tue Jun 7 14:29:36 2022] POST /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:29:36.216107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-1b7b19a9-facc-4a12-b136-53944d2ec89a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:36.218686 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-1b7b19a9-facc-4a12-b136-53944d2ec89a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:36.228313 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1b7b19a9-facc-4a12-b136-53944d2ec89a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:36.229071 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1b7b19a9-facc-4a12-b136-53944d2ec89a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:36.246142 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1b7b19a9-facc-4a12-b136-53944d2ec89a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:36.246777 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1b7b19a9-facc-4a12-b136-53944d2ec89a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:36.482778 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-1b7b19a9-facc-4a12-b136-53944d2ec89a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:36.496831 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-1b7b19a9-facc-4a12-b136-53944d2ec89a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:36.505078 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-1b7b19a9-facc-4a12-b136-53944d2ec89a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:36.506808 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-1b7b19a9-facc-4a12-b136-53944d2ec89a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1749 microversion: 2.20 time: 0.296983 Jun 07 14:29:36.507754 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 428/823] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:36 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1749 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:36.664775 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7a954f84-4bad-49d4-b297-9b2f5d47fccc tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:36.666019 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7a954f84-4bad-49d4-b297-9b2f5d47fccc tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:36.674545 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7a954f84-4bad-49d4-b297-9b2f5d47fccc tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:36.675237 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7a954f84-4bad-49d4-b297-9b2f5d47fccc tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:36.676174 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7a954f84-4bad-49d4-b297-9b2f5d47fccc tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:36.676767 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7a954f84-4bad-49d4-b297-9b2f5d47fccc tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:36.739528 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-293519a3-7f89-48af-a9bd-cd18302d3f4a req-3d4f2ef8-330e-4907-964d-3b10eef40f77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ed6c33-30a8-4a3b-aba5-57610c2ec718", "name": "network-vif-unplugged", "status": "completed", "tag": "3f5b3dca-4f2b-407e-9796-9a5c5a344abb"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:29:36.760913 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-293519a3-7f89-48af-a9bd-cd18302d3f4a req-3d4f2ef8-330e-4907-964d-3b10eef40f77 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:36.764594 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-293519a3-7f89-48af-a9bd-cd18302d3f4a req-3d4f2ef8-330e-4907-964d-3b10eef40f77 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:36.802267 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.compute.server_external_events [req-293519a3-7f89-48af-a9bd-cd18302d3f4a req-3d4f2ef8-330e-4907-964d-3b10eef40f77 service nova] Unable to find a host for instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718. Dropping event network-vif-unplugged {{(pid=117565) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 07 14:29:36.803512 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-293519a3-7f89-48af-a9bd-cd18302d3f4a req-3d4f2ef8-330e-4907-964d-3b10eef40f77 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.070828 Jun 07 14:29:36.804579 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 429/824] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 72 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 07 14:29:36.957526 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-7a954f84-4bad-49d4-b297-9b2f5d47fccc tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:36.966503 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7a954f84-4bad-49d4-b297-9b2f5d47fccc tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 200 len: 1266 microversion: 2.1 time: 0.306438 Jun 07 14:29:36.967839 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 396/825] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:36 2022] GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:37.324414 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-8844cce1-a391-468e-85cc-b7497dc36752 req-4a7b5d03-8420-412c-8e06-a65ca0fe755a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c291fe41-2937-47d4-b460-bacb77437438", "tag": "8116f16b-8bdf-45d6-b0d0-8c403dbe11a9"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:29:37.348595 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-8844cce1-a391-468e-85cc-b7497dc36752 req-4a7b5d03-8420-412c-8e06-a65ca0fe755a service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:37.349176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-8844cce1-a391-468e-85cc-b7497dc36752 req-4a7b5d03-8420-412c-8e06-a65ca0fe755a service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:37.378118 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-8844cce1-a391-468e-85cc-b7497dc36752 req-4a7b5d03-8420-412c-8e06-a65ca0fe755a service nova] Creating event network-changed:8116f16b-8bdf-45d6-b0d0-8c403dbe11a9 for instance c291fe41-2937-47d4-b460-bacb77437438 on hv-cinder-83608 Jun 07 14:29:37.383493 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-8844cce1-a391-468e-85cc-b7497dc36752 req-4a7b5d03-8420-412c-8e06-a65ca0fe755a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071116 Jun 07 14:29:37.384708 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 430/826] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:29:37.525878 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-68811933-ad1e-4afc-9bff-3125e6117415 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:37.526698 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-68811933-ad1e-4afc-9bff-3125e6117415 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:37.533754 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-68811933-ad1e-4afc-9bff-3125e6117415 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:37.534203 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-68811933-ad1e-4afc-9bff-3125e6117415 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:37.534979 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-68811933-ad1e-4afc-9bff-3125e6117415 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:37.535445 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-68811933-ad1e-4afc-9bff-3125e6117415 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:37.789282 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-68811933-ad1e-4afc-9bff-3125e6117415 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:37.799403 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-68811933-ad1e-4afc-9bff-3125e6117415 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:37.800962 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-68811933-ad1e-4afc-9bff-3125e6117415 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:37.802148 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-68811933-ad1e-4afc-9bff-3125e6117415 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1751 microversion: 2.20 time: 0.280410 Jun 07 14:29:37.802714 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 397/827] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:37 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1751 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:37.986527 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-38a691c5-d4fb-4f02-a4ad-12a1280fcd7c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:37.987646 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-38a691c5-d4fb-4f02-a4ad-12a1280fcd7c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:37.993803 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-38a691c5-d4fb-4f02-a4ad-12a1280fcd7c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:37.994250 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-38a691c5-d4fb-4f02-a4ad-12a1280fcd7c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:37.995009 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-38a691c5-d4fb-4f02-a4ad-12a1280fcd7c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:37.995468 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-38a691c5-d4fb-4f02-a4ad-12a1280fcd7c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:38.214582 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-38a691c5-d4fb-4f02-a4ad-12a1280fcd7c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:38.222732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-38a691c5-d4fb-4f02-a4ad-12a1280fcd7c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 200 len: 1266 microversion: 2.1 time: 0.240677 Jun 07 14:29:38.223326 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 431/828] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:37 2022] GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:38.821689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9a1d3aff-b468-40fd-9b1a-c1d3563e025c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:38.822235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9a1d3aff-b468-40fd-9b1a-c1d3563e025c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:38.829353 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9a1d3aff-b468-40fd-9b1a-c1d3563e025c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:38.829798 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9a1d3aff-b468-40fd-9b1a-c1d3563e025c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:38.830567 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9a1d3aff-b468-40fd-9b1a-c1d3563e025c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:38.831000 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9a1d3aff-b468-40fd-9b1a-c1d3563e025c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:38.965654 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9a1d3aff-b468-40fd-9b1a-c1d3563e025c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:38.974380 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9a1d3aff-b468-40fd-9b1a-c1d3563e025c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:38.976021 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9a1d3aff-b468-40fd-9b1a-c1d3563e025c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:38.977285 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9a1d3aff-b468-40fd-9b1a-c1d3563e025c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1807 microversion: 2.20 time: 0.159734 Jun 07 14:29:38.977926 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 398/829] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:38 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:39.239375 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d5fd0315-4cfc-44d0-addd-af3402eb6c7d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:39.239996 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-d5fd0315-4cfc-44d0-addd-af3402eb6c7d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:39.246360 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d5fd0315-4cfc-44d0-addd-af3402eb6c7d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:39.246806 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d5fd0315-4cfc-44d0-addd-af3402eb6c7d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:39.247598 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d5fd0315-4cfc-44d0-addd-af3402eb6c7d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:39.248558 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d5fd0315-4cfc-44d0-addd-af3402eb6c7d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:39.410186 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-d5fd0315-4cfc-44d0-addd-af3402eb6c7d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:39.423195 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-d5fd0315-4cfc-44d0-addd-af3402eb6c7d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 200 len: 1266 microversion: 2.1 time: 0.187258 Jun 07 14:29:39.436538 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 432/830] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:39 2022] GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:39.995591 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-cb7922be-6c57-4b3b-bce2-c7bfbf8758f1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:39.996240 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-cb7922be-6c57-4b3b-bce2-c7bfbf8758f1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:40.003086 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cb7922be-6c57-4b3b-bce2-c7bfbf8758f1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:40.004170 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cb7922be-6c57-4b3b-bce2-c7bfbf8758f1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:40.004958 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cb7922be-6c57-4b3b-bce2-c7bfbf8758f1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:40.005391 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cb7922be-6c57-4b3b-bce2-c7bfbf8758f1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:40.148488 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-cb7922be-6c57-4b3b-bce2-c7bfbf8758f1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:40.163840 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-cb7922be-6c57-4b3b-bce2-c7bfbf8758f1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:40.165465 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-cb7922be-6c57-4b3b-bce2-c7bfbf8758f1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:40.166745 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-cb7922be-6c57-4b3b-bce2-c7bfbf8758f1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1807 microversion: 2.20 time: 0.175111 Jun 07 14:29:40.174407 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 399/831] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:39 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:40.441415 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-107b7491-4ee2-4a4e-b102-21e6693ea3c6 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:40.441933 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-107b7491-4ee2-4a4e-b102-21e6693ea3c6 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:40.449280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-107b7491-4ee2-4a4e-b102-21e6693ea3c6 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:40.449736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-107b7491-4ee2-4a4e-b102-21e6693ea3c6 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:40.450506 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-107b7491-4ee2-4a4e-b102-21e6693ea3c6 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:40.452311 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-107b7491-4ee2-4a4e-b102-21e6693ea3c6 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:40.599436 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-107b7491-4ee2-4a4e-b102-21e6693ea3c6 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:40.606952 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-107b7491-4ee2-4a4e-b102-21e6693ea3c6 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 200 len: 1266 microversion: 2.1 time: 0.169414 Jun 07 14:29:40.616040 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 433/832] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:40 2022] GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:29:41.186520 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a7fdd84a-8fbd-40f1-9fb4-7883ad990bb4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:41.187102 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a7fdd84a-8fbd-40f1-9fb4-7883ad990bb4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:41.193834 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a7fdd84a-8fbd-40f1-9fb4-7883ad990bb4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:41.194277 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a7fdd84a-8fbd-40f1-9fb4-7883ad990bb4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:41.195240 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a7fdd84a-8fbd-40f1-9fb4-7883ad990bb4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:41.195681 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a7fdd84a-8fbd-40f1-9fb4-7883ad990bb4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:41.336095 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a7fdd84a-8fbd-40f1-9fb4-7883ad990bb4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:41.347647 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a7fdd84a-8fbd-40f1-9fb4-7883ad990bb4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:41.349163 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a7fdd84a-8fbd-40f1-9fb4-7883ad990bb4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:41.350395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a7fdd84a-8fbd-40f1-9fb4-7883ad990bb4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1807 microversion: 2.20 time: 0.168652 Jun 07 14:29:41.350959 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 400/833] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:41 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:41.624958 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-17c33928-3721-4591-b6c3-8bc15dbeef46 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:41.625717 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-17c33928-3721-4591-b6c3-8bc15dbeef46 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:41.632191 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-17c33928-3721-4591-b6c3-8bc15dbeef46 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:41.632715 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-17c33928-3721-4591-b6c3-8bc15dbeef46 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:41.633486 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-17c33928-3721-4591-b6c3-8bc15dbeef46 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:41.633915 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-17c33928-3721-4591-b6c3-8bc15dbeef46 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:41.778393 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-17c33928-3721-4591-b6c3-8bc15dbeef46 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:41.787392 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-17c33928-3721-4591-b6c3-8bc15dbeef46 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 200 len: 1266 microversion: 2.1 time: 0.167050 Jun 07 14:29:41.787965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 434/834] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:41 2022] GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:42.369301 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-63570d45-d339-4651-a755-ebf5942537a4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:42.369955 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-63570d45-d339-4651-a755-ebf5942537a4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:42.377426 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-63570d45-d339-4651-a755-ebf5942537a4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:42.377880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-63570d45-d339-4651-a755-ebf5942537a4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:42.378665 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-63570d45-d339-4651-a755-ebf5942537a4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:42.379109 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-63570d45-d339-4651-a755-ebf5942537a4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:42.522339 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-63570d45-d339-4651-a755-ebf5942537a4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:42.531032 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-63570d45-d339-4651-a755-ebf5942537a4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:42.532592 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-63570d45-d339-4651-a755-ebf5942537a4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:42.533782 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-63570d45-d339-4651-a755-ebf5942537a4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1807 microversion: 2.20 time: 0.168537 Jun 07 14:29:42.534343 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 401/835] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:42 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:42.805390 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-a73eb4dc-0759-46f2-801c-d3d21ad5c457 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:42.806136 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-a73eb4dc-0759-46f2-801c-d3d21ad5c457 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:42.813710 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a73eb4dc-0759-46f2-801c-d3d21ad5c457 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:42.814154 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a73eb4dc-0759-46f2-801c-d3d21ad5c457 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:42.814927 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a73eb4dc-0759-46f2-801c-d3d21ad5c457 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:42.815387 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a73eb4dc-0759-46f2-801c-d3d21ad5c457 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:42.974488 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-a73eb4dc-0759-46f2-801c-d3d21ad5c457 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:42.982970 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-a73eb4dc-0759-46f2-801c-d3d21ad5c457 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 200 len: 1266 microversion: 2.1 time: 0.181545 Jun 07 14:29:42.984073 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 435/836] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:42 2022] GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:43.551055 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3db02e8a-3e57-4bef-a0bf-fd1862cf5468 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:43.551794 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3db02e8a-3e57-4bef-a0bf-fd1862cf5468 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:43.558995 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:43.561858 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3db02e8a-3e57-4bef-a0bf-fd1862cf5468 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:43.562324 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3db02e8a-3e57-4bef-a0bf-fd1862cf5468 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:43.563320 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3db02e8a-3e57-4bef-a0bf-fd1862cf5468 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:43.563769 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3db02e8a-3e57-4bef-a0bf-fd1862cf5468 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:43.714983 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3db02e8a-3e57-4bef-a0bf-fd1862cf5468 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:43.733260 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3db02e8a-3e57-4bef-a0bf-fd1862cf5468 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:43.734763 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3db02e8a-3e57-4bef-a0bf-fd1862cf5468 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:43.735974 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3db02e8a-3e57-4bef-a0bf-fd1862cf5468 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1807 microversion: 2.20 time: 0.188838 Jun 07 14:29:43.736535 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 402/837] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:43 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:44.000666 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-75b1ce7c-5fc9-47ee-870f-ffec5cf91d40 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:44.001192 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-75b1ce7c-5fc9-47ee-870f-ffec5cf91d40 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:44.007425 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=2 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:44.008760 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=6 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:44.011616 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-75b1ce7c-5fc9-47ee-870f-ffec5cf91d40 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:44.012238 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-75b1ce7c-5fc9-47ee-870f-ffec5cf91d40 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:44.013230 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-75b1ce7c-5fc9-47ee-870f-ffec5cf91d40 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:44.013844 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-75b1ce7c-5fc9-47ee-870f-ffec5cf91d40 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:44.158637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-75b1ce7c-5fc9-47ee-870f-ffec5cf91d40 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:44.167492 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-75b1ce7c-5fc9-47ee-870f-ffec5cf91d40 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 200 len: 1266 microversion: 2.1 time: 0.171430 Jun 07 14:29:44.168994 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 436/838] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:43 2022] GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:44.766277 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3bbdd3cf-e30c-4568-bfb2-0630728449e5 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:44.767079 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3bbdd3cf-e30c-4568-bfb2-0630728449e5 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:44.773784 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3bbdd3cf-e30c-4568-bfb2-0630728449e5 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:44.774509 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3bbdd3cf-e30c-4568-bfb2-0630728449e5 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:44.775521 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3bbdd3cf-e30c-4568-bfb2-0630728449e5 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:44.776152 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3bbdd3cf-e30c-4568-bfb2-0630728449e5 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:44.913487 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3bbdd3cf-e30c-4568-bfb2-0630728449e5 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:44.922943 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3bbdd3cf-e30c-4568-bfb2-0630728449e5 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:44.924517 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3bbdd3cf-e30c-4568-bfb2-0630728449e5 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:44.925696 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3bbdd3cf-e30c-4568-bfb2-0630728449e5 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1807 microversion: 2.20 time: 0.166117 Jun 07 14:29:44.926263 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 403/839] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:44 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:45.184569 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-aeb63010-6217-4ac3-b2cc-62f8b9e53dc6 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:45.186291 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-aeb63010-6217-4ac3-b2cc-62f8b9e53dc6 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:45.193578 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-aeb63010-6217-4ac3-b2cc-62f8b9e53dc6 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:45.194134 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-aeb63010-6217-4ac3-b2cc-62f8b9e53dc6 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:45.194992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-aeb63010-6217-4ac3-b2cc-62f8b9e53dc6 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:45.195565 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-aeb63010-6217-4ac3-b2cc-62f8b9e53dc6 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:45.201187 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:45.349202 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-aeb63010-6217-4ac3-b2cc-62f8b9e53dc6 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:45.358246 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-aeb63010-6217-4ac3-b2cc-62f8b9e53dc6 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 200 len: 1266 microversion: 2.1 time: 0.177316 Jun 07 14:29:45.359021 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 437/840] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:45 2022] GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:45.944546 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c4adfc61-444f-47f3-9aff-5ee4837c1a1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:45.945146 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c4adfc61-444f-47f3-9aff-5ee4837c1a1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:45.952690 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c4adfc61-444f-47f3-9aff-5ee4837c1a1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:45.953235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c4adfc61-444f-47f3-9aff-5ee4837c1a1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:45.954136 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c4adfc61-444f-47f3-9aff-5ee4837c1a1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:45.954579 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c4adfc61-444f-47f3-9aff-5ee4837c1a1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:46.097711 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c4adfc61-444f-47f3-9aff-5ee4837c1a1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:46.107956 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c4adfc61-444f-47f3-9aff-5ee4837c1a1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:46.109758 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c4adfc61-444f-47f3-9aff-5ee4837c1a1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:46.111133 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c4adfc61-444f-47f3-9aff-5ee4837c1a1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1807 microversion: 2.20 time: 0.170565 Jun 07 14:29:46.111911 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 404/841] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:45 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:46.376120 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ee536de9-f94b-468d-be83-d767f2e7382c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:46.376742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ee536de9-f94b-468d-be83-d767f2e7382c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:46.383585 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ee536de9-f94b-468d-be83-d767f2e7382c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:46.384043 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ee536de9-f94b-468d-be83-d767f2e7382c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:46.384827 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ee536de9-f94b-468d-be83-d767f2e7382c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:46.385409 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ee536de9-f94b-468d-be83-d767f2e7382c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:46.538985 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ee536de9-f94b-468d-be83-d767f2e7382c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:46.553752 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ee536de9-f94b-468d-be83-d767f2e7382c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 200 len: 1266 microversion: 2.1 time: 0.179282 Jun 07 14:29:46.555988 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 438/842] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:46 2022] GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:47.131052 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-328f191b-f025-43fb-a8f7-9069ff26c1c6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:47.131696 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-328f191b-f025-43fb-a8f7-9069ff26c1c6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:47.137918 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-328f191b-f025-43fb-a8f7-9069ff26c1c6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:47.138366 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-328f191b-f025-43fb-a8f7-9069ff26c1c6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:47.139131 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-328f191b-f025-43fb-a8f7-9069ff26c1c6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:47.139592 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-328f191b-f025-43fb-a8f7-9069ff26c1c6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:47.277273 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-328f191b-f025-43fb-a8f7-9069ff26c1c6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:47.285865 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-328f191b-f025-43fb-a8f7-9069ff26c1c6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:47.287387 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-328f191b-f025-43fb-a8f7-9069ff26c1c6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:47.288539 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-328f191b-f025-43fb-a8f7-9069ff26c1c6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1807 microversion: 2.20 time: 0.161390 Jun 07 14:29:47.289103 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 405/843] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:47 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:47.573602 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-f7c14080-d662-4f47-a5b9-80fb66b526a3 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:47.574216 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-f7c14080-d662-4f47-a5b9-80fb66b526a3 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:47.580932 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f7c14080-d662-4f47-a5b9-80fb66b526a3 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:47.581381 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f7c14080-d662-4f47-a5b9-80fb66b526a3 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:47.582138 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f7c14080-d662-4f47-a5b9-80fb66b526a3 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:47.582573 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f7c14080-d662-4f47-a5b9-80fb66b526a3 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:47.717424 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-f7c14080-d662-4f47-a5b9-80fb66b526a3 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:47.724790 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-f7c14080-d662-4f47-a5b9-80fb66b526a3 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 200 len: 1266 microversion: 2.1 time: 0.155058 Jun 07 14:29:47.725363 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 439/844] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:47 2022] GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:48.305911 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-aac0aaf5-0652-402f-8a0d-7d4f2baca601 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:48.306434 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-aac0aaf5-0652-402f-8a0d-7d4f2baca601 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:48.313025 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-aac0aaf5-0652-402f-8a0d-7d4f2baca601 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:48.313476 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-aac0aaf5-0652-402f-8a0d-7d4f2baca601 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:48.314243 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-aac0aaf5-0652-402f-8a0d-7d4f2baca601 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:48.314686 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-aac0aaf5-0652-402f-8a0d-7d4f2baca601 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:48.441685 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-aac0aaf5-0652-402f-8a0d-7d4f2baca601 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:48.449973 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-aac0aaf5-0652-402f-8a0d-7d4f2baca601 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:48.452025 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-aac0aaf5-0652-402f-8a0d-7d4f2baca601 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:48.453229 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-aac0aaf5-0652-402f-8a0d-7d4f2baca601 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1807 microversion: 2.20 time: 0.151324 Jun 07 14:29:48.453799 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 406/845] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:48 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:48.741810 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-466aabe6-28d9-4e0d-9b9b-ce18c99fc0d3 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:48.742420 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-466aabe6-28d9-4e0d-9b9b-ce18c99fc0d3 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:48.749552 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-466aabe6-28d9-4e0d-9b9b-ce18c99fc0d3 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:48.749999 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-466aabe6-28d9-4e0d-9b9b-ce18c99fc0d3 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:48.750754 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-466aabe6-28d9-4e0d-9b9b-ce18c99fc0d3 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:48.751182 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-466aabe6-28d9-4e0d-9b9b-ce18c99fc0d3 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:48.878811 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-466aabe6-28d9-4e0d-9b9b-ce18c99fc0d3 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:48.886275 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-466aabe6-28d9-4e0d-9b9b-ce18c99fc0d3 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 200 len: 1266 microversion: 2.1 time: 0.148323 Jun 07 14:29:48.886842 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 440/846] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:48 2022] GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:49.470598 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-143bf659-d5a4-45a4-9537-5a483ab227b4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:49.471205 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-143bf659-d5a4-45a4-9537-5a483ab227b4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:49.477833 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-143bf659-d5a4-45a4-9537-5a483ab227b4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:49.478278 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-143bf659-d5a4-45a4-9537-5a483ab227b4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:49.479039 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-143bf659-d5a4-45a4-9537-5a483ab227b4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:49.479507 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-143bf659-d5a4-45a4-9537-5a483ab227b4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:49.615589 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-143bf659-d5a4-45a4-9537-5a483ab227b4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:49.624711 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-143bf659-d5a4-45a4-9537-5a483ab227b4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:49.626136 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-143bf659-d5a4-45a4-9537-5a483ab227b4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:49.627313 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-143bf659-d5a4-45a4-9537-5a483ab227b4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1807 microversion: 2.20 time: 0.160703 Jun 07 14:29:49.627868 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 407/847] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:49 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:49.903410 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-b8a23f27-962d-47ad-8058-6e4e50d55862 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:49.904099 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-b8a23f27-962d-47ad-8058-6e4e50d55862 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:49.910557 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b8a23f27-962d-47ad-8058-6e4e50d55862 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:49.911009 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b8a23f27-962d-47ad-8058-6e4e50d55862 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:49.911793 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b8a23f27-962d-47ad-8058-6e4e50d55862 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:49.912231 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b8a23f27-962d-47ad-8058-6e4e50d55862 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:50.040648 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-b8a23f27-962d-47ad-8058-6e4e50d55862 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:50.048942 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-b8a23f27-962d-47ad-8058-6e4e50d55862 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 200 len: 1266 microversion: 2.1 time: 0.149529 Jun 07 14:29:50.049499 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 441/848] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:49 2022] GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:29:50.645347 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-820373c8-8267-43cb-b086-7d4bc73bfc1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:50.645968 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-820373c8-8267-43cb-b086-7d4bc73bfc1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:50.652428 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-820373c8-8267-43cb-b086-7d4bc73bfc1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:50.652878 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-820373c8-8267-43cb-b086-7d4bc73bfc1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:50.653649 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-820373c8-8267-43cb-b086-7d4bc73bfc1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:50.654806 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-820373c8-8267-43cb-b086-7d4bc73bfc1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:50.789758 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-820373c8-8267-43cb-b086-7d4bc73bfc1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:50.798564 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-820373c8-8267-43cb-b086-7d4bc73bfc1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:50.800089 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-820373c8-8267-43cb-b086-7d4bc73bfc1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:50.801239 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-820373c8-8267-43cb-b086-7d4bc73bfc1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1807 microversion: 2.20 time: 0.159877 Jun 07 14:29:50.801828 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 408/849] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:50 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:51.066296 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-4958ca19-f1bf-425b-a6e1-c8e40646a365 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:51.066845 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-4958ca19-f1bf-425b-a6e1-c8e40646a365 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:51.072892 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4958ca19-f1bf-425b-a6e1-c8e40646a365 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:51.073345 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4958ca19-f1bf-425b-a6e1-c8e40646a365 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:51.074120 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4958ca19-f1bf-425b-a6e1-c8e40646a365 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:51.074564 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4958ca19-f1bf-425b-a6e1-c8e40646a365 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:51.205683 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-4958ca19-f1bf-425b-a6e1-c8e40646a365 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:51.213036 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-4958ca19-f1bf-425b-a6e1-c8e40646a365 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 200 len: 1266 microversion: 2.1 time: 0.150924 Jun 07 14:29:51.213595 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 442/850] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:51 2022] GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:51.819244 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-160dfa36-7ba4-4562-98f7-e98a92fc9b27 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:51.819895 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-160dfa36-7ba4-4562-98f7-e98a92fc9b27 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:51.826457 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-160dfa36-7ba4-4562-98f7-e98a92fc9b27 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:51.826906 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-160dfa36-7ba4-4562-98f7-e98a92fc9b27 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:51.827707 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-160dfa36-7ba4-4562-98f7-e98a92fc9b27 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:51.828147 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-160dfa36-7ba4-4562-98f7-e98a92fc9b27 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:51.954595 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-160dfa36-7ba4-4562-98f7-e98a92fc9b27 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:51.962952 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-160dfa36-7ba4-4562-98f7-e98a92fc9b27 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:51.964799 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-160dfa36-7ba4-4562-98f7-e98a92fc9b27 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:51.965962 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-160dfa36-7ba4-4562-98f7-e98a92fc9b27 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1807 microversion: 2.20 time: 0.150614 Jun 07 14:29:51.967169 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 409/851] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:51 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:52.230152 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-9cb41378-84f6-4343-b5b6-1d702c1ea91a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:52.230795 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-9cb41378-84f6-4343-b5b6-1d702c1ea91a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:52.237432 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9cb41378-84f6-4343-b5b6-1d702c1ea91a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:52.237907 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9cb41378-84f6-4343-b5b6-1d702c1ea91a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:52.238663 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9cb41378-84f6-4343-b5b6-1d702c1ea91a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:52.239099 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9cb41378-84f6-4343-b5b6-1d702c1ea91a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:52.372558 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-9cb41378-84f6-4343-b5b6-1d702c1ea91a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:52.381040 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-9cb41378-84f6-4343-b5b6-1d702c1ea91a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 200 len: 1266 microversion: 2.1 time: 0.154877 Jun 07 14:29:52.381605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 443/852] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:52 2022] GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:52.681444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-5096b30a-69ff-47f0-8de7-48ebb2cbef6e req-478057e5-8495-44d3-aa58-51a102e89553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c291fe41-2937-47d4-b460-bacb77437438", "name": "network-vif-plugged", "status": "completed", "tag": "8116f16b-8bdf-45d6-b0d0-8c403dbe11a9"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:29:52.691395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-5096b30a-69ff-47f0-8de7-48ebb2cbef6e req-478057e5-8495-44d3-aa58-51a102e89553 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:52.691891 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-5096b30a-69ff-47f0-8de7-48ebb2cbef6e req-478057e5-8495-44d3-aa58-51a102e89553 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:52.705922 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-5096b30a-69ff-47f0-8de7-48ebb2cbef6e req-478057e5-8495-44d3-aa58-51a102e89553 service nova] Creating event network-vif-plugged:8116f16b-8bdf-45d6-b0d0-8c403dbe11a9 for instance c291fe41-2937-47d4-b460-bacb77437438 on hv-cinder-83608 Jun 07 14:29:52.711746 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-5096b30a-69ff-47f0-8de7-48ebb2cbef6e req-478057e5-8495-44d3-aa58-51a102e89553 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033890 Jun 07 14:29:52.712451 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 410/853] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:29:52.985486 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-dbd10f61-ac2e-4012-acfe-718148fe65da tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:52.986108 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-dbd10f61-ac2e-4012-acfe-718148fe65da tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:52.992181 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-dbd10f61-ac2e-4012-acfe-718148fe65da tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:52.992633 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-dbd10f61-ac2e-4012-acfe-718148fe65da tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:52.993392 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-dbd10f61-ac2e-4012-acfe-718148fe65da tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:52.993831 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-dbd10f61-ac2e-4012-acfe-718148fe65da tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:53.121023 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-dbd10f61-ac2e-4012-acfe-718148fe65da tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:53.129382 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-dbd10f61-ac2e-4012-acfe-718148fe65da tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:53.130895 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-dbd10f61-ac2e-4012-acfe-718148fe65da tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:53.132080 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-dbd10f61-ac2e-4012-acfe-718148fe65da tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1807 microversion: 2.20 time: 0.151138 Jun 07 14:29:53.132638 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 444/854] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:52 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:53.399045 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1e5ac5fd-1975-4a55-b7d5-9acb7189c17b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:53.399768 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1e5ac5fd-1975-4a55-b7d5-9acb7189c17b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:53.406562 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1e5ac5fd-1975-4a55-b7d5-9acb7189c17b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:53.407010 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1e5ac5fd-1975-4a55-b7d5-9acb7189c17b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:53.407790 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1e5ac5fd-1975-4a55-b7d5-9acb7189c17b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:53.408227 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1e5ac5fd-1975-4a55-b7d5-9acb7189c17b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:53.542032 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1e5ac5fd-1975-4a55-b7d5-9acb7189c17b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:53.550259 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1e5ac5fd-1975-4a55-b7d5-9acb7189c17b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 200 len: 1266 microversion: 2.1 time: 0.155894 Jun 07 14:29:53.550827 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 411/855] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:53 2022] GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:54.150689 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ef953fd8-5adb-4594-ad75-6d48283f7a99 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:54.151364 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ef953fd8-5adb-4594-ad75-6d48283f7a99 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:54.158853 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ef953fd8-5adb-4594-ad75-6d48283f7a99 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:54.159345 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ef953fd8-5adb-4594-ad75-6d48283f7a99 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:54.160121 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ef953fd8-5adb-4594-ad75-6d48283f7a99 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:54.160564 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ef953fd8-5adb-4594-ad75-6d48283f7a99 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:54.291117 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ef953fd8-5adb-4594-ad75-6d48283f7a99 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:54.300274 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ef953fd8-5adb-4594-ad75-6d48283f7a99 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:54.301775 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ef953fd8-5adb-4594-ad75-6d48283f7a99 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:54.302935 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ef953fd8-5adb-4594-ad75-6d48283f7a99 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1807 microversion: 2.20 time: 0.156201 Jun 07 14:29:54.303541 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 445/856] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:54 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:54.566723 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-26e3ffbd-a7a0-49be-b4cf-7675ba25926c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:54.567379 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-26e3ffbd-a7a0-49be-b4cf-7675ba25926c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:54.573869 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-26e3ffbd-a7a0-49be-b4cf-7675ba25926c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:54.574315 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-26e3ffbd-a7a0-49be-b4cf-7675ba25926c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:54.575073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-26e3ffbd-a7a0-49be-b4cf-7675ba25926c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:54.575531 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-26e3ffbd-a7a0-49be-b4cf-7675ba25926c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:54.598631 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:54.716072 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-26e3ffbd-a7a0-49be-b4cf-7675ba25926c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:54.723627 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-26e3ffbd-a7a0-49be-b4cf-7675ba25926c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 200 len: 1452 microversion: 2.1 time: 0.160765 Jun 07 14:29:54.724196 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 412/857] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:54 2022] GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:54.739461 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ecebffa2-a2ba-4c3a-b0cd-4fbec8c7fa48 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:54.740077 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ecebffa2-a2ba-4c3a-b0cd-4fbec8c7fa48 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:54.745962 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ecebffa2-a2ba-4c3a-b0cd-4fbec8c7fa48 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:54.746410 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ecebffa2-a2ba-4c3a-b0cd-4fbec8c7fa48 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:54.747159 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ecebffa2-a2ba-4c3a-b0cd-4fbec8c7fa48 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:54.748120 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ecebffa2-a2ba-4c3a-b0cd-4fbec8c7fa48 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:54.881219 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ecebffa2-a2ba-4c3a-b0cd-4fbec8c7fa48 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:54.889353 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ecebffa2-a2ba-4c3a-b0cd-4fbec8c7fa48 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 200 len: 1452 microversion: 2.1 time: 0.152879 Jun 07 14:29:54.889923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 446/858] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:29:54 2022] GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:29:55.325339 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-65470561-4944-4f4e-b9f9-de2d0f62b0bc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:55.326104 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-65470561-4944-4f4e-b9f9-de2d0f62b0bc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:55.331344 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=74 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:55.332975 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-65470561-4944-4f4e-b9f9-de2d0f62b0bc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:55.333431 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-65470561-4944-4f4e-b9f9-de2d0f62b0bc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:55.334212 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-65470561-4944-4f4e-b9f9-de2d0f62b0bc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:55.334653 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-65470561-4944-4f4e-b9f9-de2d0f62b0bc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:55.571556 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-65470561-4944-4f4e-b9f9-de2d0f62b0bc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:55.581085 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-65470561-4944-4f4e-b9f9-de2d0f62b0bc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:55.582599 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-65470561-4944-4f4e-b9f9-de2d0f62b0bc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:55.583828 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-65470561-4944-4f4e-b9f9-de2d0f62b0bc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1807 microversion: 2.20 time: 0.264839 Jun 07 14:29:55.584396 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 413/859] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:55 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1807 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:56.603249 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-178f3c8e-945d-4e1b-a0fe-80251c3867ac tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:56.603954 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-178f3c8e-945d-4e1b-a0fe-80251c3867ac tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:56.611657 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-178f3c8e-945d-4e1b-a0fe-80251c3867ac tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:56.612203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-178f3c8e-945d-4e1b-a0fe-80251c3867ac tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:56.613217 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-178f3c8e-945d-4e1b-a0fe-80251c3867ac tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:56.613763 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-178f3c8e-945d-4e1b-a0fe-80251c3867ac tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:56.841047 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-178f3c8e-945d-4e1b-a0fe-80251c3867ac tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:56.851595 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-178f3c8e-945d-4e1b-a0fe-80251c3867ac tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:56.853546 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-178f3c8e-945d-4e1b-a0fe-80251c3867ac tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:56.854767 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-178f3c8e-945d-4e1b-a0fe-80251c3867ac tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1807 microversion: 2.20 time: 0.255582 Jun 07 14:29:56.855449 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 447/860] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:56 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1807 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:56.904224 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-bba99f70-9f32-4f30-ba33-0881c6d76557 req-a3659991-aa92-49ac-a639-f2311312c828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c291fe41-2937-47d4-b460-bacb77437438", "tag": "8116f16b-8bdf-45d6-b0d0-8c403dbe11a9"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:29:56.913300 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-bba99f70-9f32-4f30-ba33-0881c6d76557 req-a3659991-aa92-49ac-a639-f2311312c828 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:56.913713 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-bba99f70-9f32-4f30-ba33-0881c6d76557 req-a3659991-aa92-49ac-a639-f2311312c828 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:56.926235 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-bba99f70-9f32-4f30-ba33-0881c6d76557 req-a3659991-aa92-49ac-a639-f2311312c828 service nova] Creating event network-changed:8116f16b-8bdf-45d6-b0d0-8c403dbe11a9 for instance c291fe41-2937-47d4-b460-bacb77437438 on hv-cinder-83608 Jun 07 14:29:56.931292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-bba99f70-9f32-4f30-ba33-0881c6d76557 req-a3659991-aa92-49ac-a639-f2311312c828 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030983 Jun 07 14:29:56.931894 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 414/861] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:29:57.873950 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-e7ebc24d-96e5-4818-9fb1-483130ad9b76 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:57.874563 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-e7ebc24d-96e5-4818-9fb1-483130ad9b76 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:57.876970 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:57.882283 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e7ebc24d-96e5-4818-9fb1-483130ad9b76 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:57.882728 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e7ebc24d-96e5-4818-9fb1-483130ad9b76 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:57.883538 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e7ebc24d-96e5-4818-9fb1-483130ad9b76 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:57.883977 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e7ebc24d-96e5-4818-9fb1-483130ad9b76 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:58.027268 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-e7ebc24d-96e5-4818-9fb1-483130ad9b76 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:58.036982 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-e7ebc24d-96e5-4818-9fb1-483130ad9b76 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:58.038859 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-e7ebc24d-96e5-4818-9fb1-483130ad9b76 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:58.039876 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-e7ebc24d-96e5-4818-9fb1-483130ad9b76 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1807 microversion: 2.20 time: 0.169910 Jun 07 14:29:58.040445 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 448/862] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:57 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:29:58.745639 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-08eef5af-af78-4207-b2bf-d97891a0f785 req-7478efba-6f40-412c-bca0-1e30e9d557a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ed6c33-30a8-4a3b-aba5-57610c2ec718", "name": "network-vif-plugged", "status": "completed", "tag": "3f5b3dca-4f2b-407e-9796-9a5c5a344abb"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:29:58.755254 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-08eef5af-af78-4207-b2bf-d97891a0f785 req-7478efba-6f40-412c-bca0-1e30e9d557a2 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:58.755777 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-08eef5af-af78-4207-b2bf-d97891a0f785 req-7478efba-6f40-412c-bca0-1e30e9d557a2 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:58.767308 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-08eef5af-af78-4207-b2bf-d97891a0f785 req-7478efba-6f40-412c-bca0-1e30e9d557a2 service nova] Creating event network-vif-plugged:3f5b3dca-4f2b-407e-9796-9a5c5a344abb for instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718 on hv-cinder-83608 Jun 07 14:29:58.772052 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-08eef5af-af78-4207-b2bf-d97891a0f785 req-7478efba-6f40-412c-bca0-1e30e9d557a2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030990 Jun 07 14:29:58.772659 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 415/863] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:29:59.059484 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-891799d5-6ddf-47a2-9161-55801462ac3a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:29:59.060110 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-891799d5-6ddf-47a2-9161-55801462ac3a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:29:59.067495 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-891799d5-6ddf-47a2-9161-55801462ac3a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:59.067950 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-891799d5-6ddf-47a2-9161-55801462ac3a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:59.068725 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-891799d5-6ddf-47a2-9161-55801462ac3a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:29:59.069239 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-891799d5-6ddf-47a2-9161-55801462ac3a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:29:59.207651 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-891799d5-6ddf-47a2-9161-55801462ac3a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:59.216335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-891799d5-6ddf-47a2-9161-55801462ac3a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:59.218525 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-891799d5-6ddf-47a2-9161-55801462ac3a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:29:59.219742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-891799d5-6ddf-47a2-9161-55801462ac3a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1807 microversion: 2.20 time: 0.164250 Jun 07 14:29:59.220312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 449/864] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:29:59 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:30:00.239353 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ee0761eb-f8d5-4436-b572-70451ca40f2c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:30:00.240043 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ee0761eb-f8d5-4436-b572-70451ca40f2c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:30:00.246217 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ee0761eb-f8d5-4436-b572-70451ca40f2c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:00.246661 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ee0761eb-f8d5-4436-b572-70451ca40f2c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:00.247451 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ee0761eb-f8d5-4436-b572-70451ca40f2c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:00.247969 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ee0761eb-f8d5-4436-b572-70451ca40f2c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:00.380267 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ee0761eb-f8d5-4436-b572-70451ca40f2c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:00.389304 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ee0761eb-f8d5-4436-b572-70451ca40f2c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:00.391178 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ee0761eb-f8d5-4436-b572-70451ca40f2c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:00.392010 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ee0761eb-f8d5-4436-b572-70451ca40f2c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1807 microversion: 2.20 time: 0.157405 Jun 07 14:30:00.392570 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 416/865] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:30:00 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:30:01.410150 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-b2d8963d-8a39-499c-80a5-ae9cecdece28 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:30:01.410793 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-b2d8963d-8a39-499c-80a5-ae9cecdece28 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:30:01.417323 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b2d8963d-8a39-499c-80a5-ae9cecdece28 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:01.417825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b2d8963d-8a39-499c-80a5-ae9cecdece28 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:01.418532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b2d8963d-8a39-499c-80a5-ae9cecdece28 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:01.418970 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b2d8963d-8a39-499c-80a5-ae9cecdece28 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:01.549664 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-b2d8963d-8a39-499c-80a5-ae9cecdece28 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:01.558154 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-b2d8963d-8a39-499c-80a5-ae9cecdece28 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:01.559687 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-b2d8963d-8a39-499c-80a5-ae9cecdece28 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:01.561212 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-b2d8963d-8a39-499c-80a5-ae9cecdece28 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1794 microversion: 2.20 time: 0.154904 Jun 07 14:30:01.561772 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 450/866] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:30:01 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1794 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:30:34.799915 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3605c425-7ebe-47bd-af61-61c59a5ff76d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:30:34.800517 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3605c425-7ebe-47bd-af61-61c59a5ff76d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:30:34.802796 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=7 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:30:34.803472 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=18 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:30:34.809054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3605c425-7ebe-47bd-af61-61c59a5ff76d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:34.809532 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3605c425-7ebe-47bd-af61-61c59a5ff76d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:34.810303 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3605c425-7ebe-47bd-af61-61c59a5ff76d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:34.810739 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3605c425-7ebe-47bd-af61-61c59a5ff76d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:34.840260 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3605c425-7ebe-47bd-af61-61c59a5ff76d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718/os-volume_attachments/95ecc405-35d2-458a-a5b2-f2b9765c0ecf" status: 200 len: 194 microversion: 2.20 time: 0.044887 Jun 07 14:30:34.840859 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 417/867] 10.222.0.81 () {60 vars in 1453 bytes} [Tue Jun 7 14:30:34 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718/os-volume_attachments/95ecc405-35d2-458a-a5b2-f2b9765c0ecf => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:30:34.903586 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-8cf8cd4f-e29e-42f4-a76e-d71b8e97fae8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:30:34.904127 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-8cf8cd4f-e29e-42f4-a76e-d71b8e97fae8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:30:34.906140 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=5 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:30:34.906780 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=82 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:30:34.913629 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8cf8cd4f-e29e-42f4-a76e-d71b8e97fae8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:34.914073 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8cf8cd4f-e29e-42f4-a76e-d71b8e97fae8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:34.914925 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8cf8cd4f-e29e-42f4-a76e-d71b8e97fae8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:34.915455 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8cf8cd4f-e29e-42f4-a76e-d71b8e97fae8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:34.999948 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.objects.instance [None req-8cf8cd4f-e29e-42f4-a76e-d71b8e97fae8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lazy-loading 'services' on Instance uuid a2ed6c33-30a8-4a3b-aba5-57610c2ec718 {{(pid=117565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:30:35.081244 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-8cf8cd4f-e29e-42f4-a76e-d71b8e97fae8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718/os-volume_attachments/95ecc405-35d2-458a-a5b2-f2b9765c0ecf" status: 202 len: 0 microversion: 2.20 time: 0.181578 Jun 07 14:30:35.081831 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 451/868] 10.222.0.81 () {60 vars in 1456 bytes} [Tue Jun 7 14:30:34 2022] DELETE /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718/os-volume_attachments/95ecc405-35d2-458a-a5b2-f2b9765c0ecf => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:30:35.090318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-122a605f-7b2f-4081-9a67-0d8bf173f71b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:30:35.091539 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-122a605f-7b2f-4081-9a67-0d8bf173f71b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:30:35.098690 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-122a605f-7b2f-4081-9a67-0d8bf173f71b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:35.099069 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-122a605f-7b2f-4081-9a67-0d8bf173f71b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:35.099876 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-122a605f-7b2f-4081-9a67-0d8bf173f71b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:35.100321 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-122a605f-7b2f-4081-9a67-0d8bf173f71b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:35.137378 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-122a605f-7b2f-4081-9a67-0d8bf173f71b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050967 Jun 07 14:30:35.138116 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 418/869] 10.222.0.81 () {60 vars in 1342 bytes} [Tue Jun 7 14:30:35 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:30:36.150716 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-e362e40c-b96e-44ab-8bf8-45a0fcdc6b03 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:30:36.153480 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-e362e40c-b96e-44ab-8bf8-45a0fcdc6b03 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:30:36.160841 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e362e40c-b96e-44ab-8bf8-45a0fcdc6b03 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:36.161362 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e362e40c-b96e-44ab-8bf8-45a0fcdc6b03 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:36.162145 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e362e40c-b96e-44ab-8bf8-45a0fcdc6b03 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:36.162590 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e362e40c-b96e-44ab-8bf8-45a0fcdc6b03 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:36.194423 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-e362e40c-b96e-44ab-8bf8-45a0fcdc6b03 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048749 Jun 07 14:30:36.194980 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 452/870] 10.222.0.81 () {60 vars in 1342 bytes} [Tue Jun 7 14:30:36 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:30:36.254487 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8e69ba96-4437-4bb8-bd4d-3ac01f3b3996 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:30:36.255017 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8e69ba96-4437-4bb8-bd4d-3ac01f3b3996 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:30:36.261658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8e69ba96-4437-4bb8-bd4d-3ac01f3b3996 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:36.262108 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8e69ba96-4437-4bb8-bd4d-3ac01f3b3996 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:36.262875 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8e69ba96-4437-4bb8-bd4d-3ac01f3b3996 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:36.263338 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8e69ba96-4437-4bb8-bd4d-3ac01f3b3996 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:36.290232 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8e69ba96-4437-4bb8-bd4d-3ac01f3b3996 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Going to try to terminate instance {{(pid=117564) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:30:36.372290 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8e69ba96-4437-4bb8-bd4d-3ac01f3b3996 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 204 len: 0 microversion: 2.20 time: 0.122363 Jun 07 14:30:36.373218 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 419/871] 10.222.0.81 () {60 vars in 1279 bytes} [Tue Jun 7 14:30:36 2022] DELETE /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 14:30:36.382374 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-bb892b8e-6b61-4ef1-bf34-a652ee9f4448 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:30:36.382993 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-bb892b8e-6b61-4ef1-bf34-a652ee9f4448 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:30:36.389230 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bb892b8e-6b61-4ef1-bf34-a652ee9f4448 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:36.389688 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bb892b8e-6b61-4ef1-bf34-a652ee9f4448 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:36.390462 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bb892b8e-6b61-4ef1-bf34-a652ee9f4448 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:36.390905 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bb892b8e-6b61-4ef1-bf34-a652ee9f4448 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:36.528218 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-bb892b8e-6b61-4ef1-bf34-a652ee9f4448 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:36.536833 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-bb892b8e-6b61-4ef1-bf34-a652ee9f4448 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:36.538429 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-bb892b8e-6b61-4ef1-bf34-a652ee9f4448 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:36.539713 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-bb892b8e-6b61-4ef1-bf34-a652ee9f4448 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1722 microversion: 2.20 time: 0.161494 Jun 07 14:30:36.540361 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 453/872] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:30:36 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:30:37.558785 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-4a99daab-b305-4d1d-a2f3-5323d88218de tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:30:37.559553 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-4a99daab-b305-4d1d-a2f3-5323d88218de tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:30:37.566886 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4a99daab-b305-4d1d-a2f3-5323d88218de tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:37.567467 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4a99daab-b305-4d1d-a2f3-5323d88218de tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:37.568248 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4a99daab-b305-4d1d-a2f3-5323d88218de tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:37.568691 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4a99daab-b305-4d1d-a2f3-5323d88218de tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:37.707503 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-4a99daab-b305-4d1d-a2f3-5323d88218de tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:37.717457 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-4a99daab-b305-4d1d-a2f3-5323d88218de tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:37.718960 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-4a99daab-b305-4d1d-a2f3-5323d88218de tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:37.720757 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-4a99daab-b305-4d1d-a2f3-5323d88218de tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1722 microversion: 2.20 time: 0.166441 Jun 07 14:30:37.721549 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 420/873] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:30:37 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:30:38.740920 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ce30a284-10bd-4dd5-992f-01a94156045e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:30:38.741543 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ce30a284-10bd-4dd5-992f-01a94156045e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:30:38.748933 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ce30a284-10bd-4dd5-992f-01a94156045e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:38.749390 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ce30a284-10bd-4dd5-992f-01a94156045e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:38.750166 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ce30a284-10bd-4dd5-992f-01a94156045e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:38.751002 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ce30a284-10bd-4dd5-992f-01a94156045e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:38.826275 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ce30a284-10bd-4dd5-992f-01a94156045e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:38.836452 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ce30a284-10bd-4dd5-992f-01a94156045e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:38.840428 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ce30a284-10bd-4dd5-992f-01a94156045e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:38.846335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ce30a284-10bd-4dd5-992f-01a94156045e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 200 len: 1655 microversion: 2.20 time: 0.105333 Jun 07 14:30:38.846335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 454/874] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:30:38 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 1655 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:30:38.878906 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-f1a75113-b57d-4001-91d0-7227ebb1e1d0 req-f2e6d575-2fc6-47f3-b9f8-86843951cf3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ed6c33-30a8-4a3b-aba5-57610c2ec718", "name": "network-vif-deleted", "tag": "3f5b3dca-4f2b-407e-9796-9a5c5a344abb"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:30:38.888307 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-f1a75113-b57d-4001-91d0-7227ebb1e1d0 req-f2e6d575-2fc6-47f3-b9f8-86843951cf3b service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:38.889099 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-f1a75113-b57d-4001-91d0-7227ebb1e1d0 req-f2e6d575-2fc6-47f3-b9f8-86843951cf3b service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:38.908566 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-f1a75113-b57d-4001-91d0-7227ebb1e1d0 req-f2e6d575-2fc6-47f3-b9f8-86843951cf3b service nova] Creating event network-vif-deleted:3f5b3dca-4f2b-407e-9796-9a5c5a344abb for instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718 on hv-cinder-83608 Jun 07 14:30:38.914548 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-f1a75113-b57d-4001-91d0-7227ebb1e1d0 req-f2e6d575-2fc6-47f3-b9f8-86843951cf3b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040019 Jun 07 14:30:38.915883 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 421/875] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:30:39.861071 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-f9976021-a853-4fc9-bf6b-ded4d42ba190 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:30:39.861919 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-f9976021-a853-4fc9-bf6b-ded4d42ba190 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:30:39.869233 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f9976021-a853-4fc9-bf6b-ded4d42ba190 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:39.869766 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f9976021-a853-4fc9-bf6b-ded4d42ba190 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:39.870611 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f9976021-a853-4fc9-bf6b-ded4d42ba190 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:39.871119 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f9976021-a853-4fc9-bf6b-ded4d42ba190 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:39.886783 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-f9976021-a853-4fc9-bf6b-ded4d42ba190 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] HTTP exception thrown: Instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718 could not be found. Jun 07 14:30:39.888637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-f9976021-a853-4fc9-bf6b-ded4d42ba190 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Request method failure captured: Jun 07 14:30:39.888637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 HTTP/1.1 Jun 07 14:30:39.888637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:30:39.888637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:30:39.888637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:30:39.888637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:30:39.888637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:30:39.888637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:30:39.888637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:30:39.888637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:30:39.888637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin2BvHw8qXohK6PwC1vEO7h5uuxZx_wOlISE40LeCzFaeGL69IFlImRQozIdjEBYOVrcVx2Zukqf3gYQtOz-oJaTLAqRfMx2wyPMTldZdiNF3yXFFqeoae4rO4M0pcxN31QXSFx33PHHi7fCBMk1qC9bjav0PveuTcxx9sWYL66eQMd8 Jun 07 14:30:39.888637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:30:39.888637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:30:39.888637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:30:39.888637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:30:39.888637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 14:30:39.888637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:30:39.888637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:30:39.888637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: 4c6a6f6bdf7743cba1a36a3e8f67cf02 Jun 07 14:30:39.888637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1238086752 Jun 07 14:30:39.888637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:30:39.888637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:30:39.890435 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4c6a6f6bdf7743cba1a36a3e8f67cf02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4c6a6f6bdf7743cba1a36a3e8f67cf02", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4c6a6f6bdf7743cba1a36a3e8f67cf02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4c6a6f6bdf7743cba1a36a3e8f67cf02"}]}] Jun 07 14:30:39.890435 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1238086752 Jun 07 14:30:39.890435 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: 4c6a6f6bdf7743cba1a36a3e8f67cf02 Jun 07 14:30:39.890435 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1238086752 Jun 07 14:30:39.890435 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-AttachVolumeShelveTestJSON-1238086752-project Jun 07 14:30:39.890435 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:30:39.890435 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:30:39.890435 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: fefdd9dfa11641a598fcc29b2ad32afc Jun 07 14:30:39.890435 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1238086752-project Jun 07 14:30:39.890435 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:30:39.890435 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718 could not be found. Jun 07 14:30:39.890435 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': 'a2ed6c33-30a8-4a3b-aba5-57610c2ec718'} Jun 07 14:30:39.891471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:30:39.891471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:30:39.891471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:30:39.891471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:30:39.891471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:30:39.891471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:30:39.891471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:30:39.891471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:30:39.891471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:30:39.891471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:30:39.891471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718 could not be found. Jun 07 14:30:39.891471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:30:39.891471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:30:39.891471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:30:39.891471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:30:39.891471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:30:39.891471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:30:39.891471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:30:39.891471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:30:39.891471 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:30:39.896315 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:30:39.896315 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:30:39.896315 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:30:39.896315 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:30:39.896315 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:30:39.896315 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:30:39.896315 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:30:39.896315 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718 could not be found. Jun 07 14:30:39.896315 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:30:39.896315 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:30:39.896315 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:30:39.896315 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:30:39.896315 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:30:39.896315 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:30:39.896315 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:30:39.896315 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:30:39.896315 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718 could not be found. Jun 07 14:30:39.896315 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:30:39.897495 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-f9976021-a853-4fc9-bf6b-ded4d42ba190 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Returning 404 to user: Instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718 could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:30:39.897495 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-f9976021-a853-4fc9-bf6b-ded4d42ba190 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 404 len: 111 microversion: 2.20 time: 0.034406 Jun 07 14:30:39.897495 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 455/876] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:30:39 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 14:30:39.901680 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c9bfdb11-baa5-4d17-bfc0-afb8d12ecdbc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '.version_select at 0x7ff37f6748b0>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:30:39.921784 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c9bfdb11-baa5-4d17-bfc0-afb8d12ecdbc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1250543104" status: 204 len: 0 microversion: 2.20 time: 0.024141 Jun 07 14:30:39.922572 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 422/877] 10.222.0.81 () {60 vars in 1261 bytes} [Tue Jun 7 14:30:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1250543104 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 14:30:40.577463 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-44b649ac-fe62-4d91-a35f-cf63841e50fc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Action: 'create', calling method: .version_select at 0x7ff3886fd3a0>, body: {"keypair": {"name": "tempest-keypair-82765413", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLNIxCAcK+BXYqRzJQA6ptb/lTaBFy1zSdepRJYPqpurllOvyE+i8gGOT8QpZ9dKwzfjDfwUM5NpVm7um6Acm0r0h4wgxC5LJroyLV8rNadP3vCT5sp1jVFCNHnmHIntw=="}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:30:40.593553 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-44b649ac-fe62-4d91-a35f-cf63841e50fc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Getting quotas for project 4c6a6f6bdf7743cba1a36a3e8f67cf02. Resources: {'key_pairs'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:30:40.598621 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-44b649ac-fe62-4d91-a35f-cf63841e50fc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Getting quotas for user fefdd9dfa11641a598fcc29b2ad32afc and project 4c6a6f6bdf7743cba1a36a3e8f67cf02. Resources: {'key_pairs'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:30:40.621944 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-44b649ac-fe62-4d91-a35f-cf63841e50fc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.048550 Jun 07 14:30:40.622547 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 456/878] 10.222.0.81 () {62 vars in 1199 bytes} [Tue Jun 7 14:30:40 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 07 14:30:41.977606 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-adc405bd-ef4b-465b-bb5c-bb351d75ddd4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1277150270", "imageRef": "2864004b-970a-480b-8453-14794f9ccca2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "430b5cee-7acd-49e1-98b5-c069d03f7257"}], "security_groups": [{"name": "tempest-securitygroup--380025238"}], "key_name": "tempest-keypair-82765413", "user_data": "}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:30:42.090339 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.network.neutron [None req-adc405bd-ef4b-465b-bb5c-bb351d75ddd4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] validate_networks() for [('430b5cee-7acd-49e1-98b5-c069d03f7257', None, None, None, None, None)] {{(pid=117564) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:30:42.459368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-adc405bd-ef4b-465b-bb5c-bb351d75ddd4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Flavor limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:30:42.459823 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-adc405bd-ef4b-465b-bb5c-bb351d75ddd4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Image limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:30:42.460297 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-adc405bd-ef4b-465b-bb5c-bb351d75ddd4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Flavor pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:30:42.460704 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-adc405bd-ef4b-465b-bb5c-bb351d75ddd4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Image pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:30:42.461114 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-adc405bd-ef4b-465b-bb5c-bb351d75ddd4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:30:42.471743 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-adc405bd-ef4b-465b-bb5c-bb351d75ddd4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:42.472188 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-adc405bd-ef4b-465b-bb5c-bb351d75ddd4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:42.472983 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-adc405bd-ef4b-465b-bb5c-bb351d75ddd4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:42.473443 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-adc405bd-ef4b-465b-bb5c-bb351d75ddd4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:42.492841 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-adc405bd-ef4b-465b-bb5c-bb351d75ddd4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Getting quotas for project 4c6a6f6bdf7743cba1a36a3e8f67cf02. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:30:42.496880 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-adc405bd-ef4b-465b-bb5c-bb351d75ddd4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Getting quotas for user fefdd9dfa11641a598fcc29b2ad32afc and project 4c6a6f6bdf7743cba1a36a3e8f67cf02. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:30:42.511719 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-adc405bd-ef4b-465b-bb5c-bb351d75ddd4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Going to run 1 instances... {{(pid=117564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:30:42.513774 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-adc405bd-ef4b-465b-bb5c-bb351d75ddd4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2864004b-970a-480b-8453-14794f9ccca2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:30:42.562979 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-adc405bd-ef4b-465b-bb5c-bb351d75ddd4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.590202 Jun 07 14:30:42.564560 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 423/879] 10.222.0.81 () {62 vars in 1187 bytes} [Tue Jun 7 14:30:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 07 14:30:42.574705 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-12b0642a-51ee-44c4-80af-6cc7312bff1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:30:42.575450 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-12b0642a-51ee-44c4-80af-6cc7312bff1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:30:42.636146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-12b0642a-51ee-44c4-80af-6cc7312bff1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:42.646117 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-12b0642a-51ee-44c4-80af-6cc7312bff1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:42.647676 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-12b0642a-51ee-44c4-80af-6cc7312bff1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:42.648785 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-12b0642a-51ee-44c4-80af-6cc7312bff1a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1280 microversion: 2.20 time: 0.078478 Jun 07 14:30:42.649342 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 457/880] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:30:42 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1280 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:30:43.667392 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a7829a02-e019-4a21-ab27-a8fad63a7ac6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:30:43.668166 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a7829a02-e019-4a21-ab27-a8fad63a7ac6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:30:43.676518 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a7829a02-e019-4a21-ab27-a8fad63a7ac6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:43.676970 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a7829a02-e019-4a21-ab27-a8fad63a7ac6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:43.677939 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a7829a02-e019-4a21-ab27-a8fad63a7ac6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:43.678386 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a7829a02-e019-4a21-ab27-a8fad63a7ac6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:43.741259 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a7829a02-e019-4a21-ab27-a8fad63a7ac6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:43.749534 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a7829a02-e019-4a21-ab27-a8fad63a7ac6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:43.751039 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a7829a02-e019-4a21-ab27-a8fad63a7ac6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:43.752679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a7829a02-e019-4a21-ab27-a8fad63a7ac6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1338 microversion: 2.20 time: 0.089945 Jun 07 14:30:43.753238 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 424/881] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:30:43 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1338 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:30:44.770666 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-c3f200da-8497-459d-83e9-c0de7a9689ca tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:30:44.771334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-c3f200da-8497-459d-83e9-c0de7a9689ca tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:30:44.778006 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c3f200da-8497-459d-83e9-c0de7a9689ca tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:44.778453 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c3f200da-8497-459d-83e9-c0de7a9689ca tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:44.779212 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c3f200da-8497-459d-83e9-c0de7a9689ca tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:44.779685 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c3f200da-8497-459d-83e9-c0de7a9689ca tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:44.913154 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-c3f200da-8497-459d-83e9-c0de7a9689ca tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:44.921054 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-c3f200da-8497-459d-83e9-c0de7a9689ca tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:44.922545 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-c3f200da-8497-459d-83e9-c0de7a9689ca tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:44.923741 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-c3f200da-8497-459d-83e9-c0de7a9689ca tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1405 microversion: 2.20 time: 0.157576 Jun 07 14:30:44.924486 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 458/882] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:30:44 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:30:45.254562 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-35802fbd-bc3f-4fa9-940f-cb3add68002e req-578697e0-7148-4788-b897-4d8c7c1ab11c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff2cef5f-a25c-4fa4-b34e-85da9efbdca8", "tag": "6a66cc9b-a903-4e8e-8ab2-720990265484"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:30:45.265686 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-35802fbd-bc3f-4fa9-940f-cb3add68002e req-578697e0-7148-4788-b897-4d8c7c1ab11c service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:45.266457 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-35802fbd-bc3f-4fa9-940f-cb3add68002e req-578697e0-7148-4788-b897-4d8c7c1ab11c service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:45.291743 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-35802fbd-bc3f-4fa9-940f-cb3add68002e req-578697e0-7148-4788-b897-4d8c7c1ab11c service nova] Creating event network-changed:6a66cc9b-a903-4e8e-8ab2-720990265484 for instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 on hv-cinder-83608 Jun 07 14:30:45.297150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-35802fbd-bc3f-4fa9-940f-cb3add68002e req-578697e0-7148-4788-b897-4d8c7c1ab11c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046160 Jun 07 14:30:45.298060 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 425/883] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:30:45.940651 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-c5af31e3-bbf1-470f-96a3-ae2f5d41e14d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:30:45.941261 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-c5af31e3-bbf1-470f-96a3-ae2f5d41e14d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:30:45.947774 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c5af31e3-bbf1-470f-96a3-ae2f5d41e14d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:45.948222 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c5af31e3-bbf1-470f-96a3-ae2f5d41e14d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:45.948979 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c5af31e3-bbf1-470f-96a3-ae2f5d41e14d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:45.949413 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c5af31e3-bbf1-470f-96a3-ae2f5d41e14d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:46.081693 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-c5af31e3-bbf1-470f-96a3-ae2f5d41e14d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:46.089493 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-c5af31e3-bbf1-470f-96a3-ae2f5d41e14d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:46.090977 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-c5af31e3-bbf1-470f-96a3-ae2f5d41e14d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:46.092358 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-c5af31e3-bbf1-470f-96a3-ae2f5d41e14d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1405 microversion: 2.20 time: 0.155835 Jun 07 14:30:46.092914 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 459/884] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:30:45 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:30:47.112526 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-54fc498e-9a43-494c-9655-f36963d0b39f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:30:47.113231 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-54fc498e-9a43-494c-9655-f36963d0b39f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:30:47.119490 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-54fc498e-9a43-494c-9655-f36963d0b39f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:47.119941 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-54fc498e-9a43-494c-9655-f36963d0b39f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:47.120709 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-54fc498e-9a43-494c-9655-f36963d0b39f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:47.121148 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-54fc498e-9a43-494c-9655-f36963d0b39f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:47.258571 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-54fc498e-9a43-494c-9655-f36963d0b39f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:47.266441 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-54fc498e-9a43-494c-9655-f36963d0b39f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:47.268163 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-54fc498e-9a43-494c-9655-f36963d0b39f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:47.269284 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-54fc498e-9a43-494c-9655-f36963d0b39f tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1405 microversion: 2.20 time: 0.162386 Jun 07 14:30:47.269846 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 426/885] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:30:47 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:30:48.287919 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-8f89e27a-50ea-436c-8749-e1772fab9923 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:30:48.288500 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-8f89e27a-50ea-436c-8749-e1772fab9923 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:30:48.294955 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8f89e27a-50ea-436c-8749-e1772fab9923 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:48.295433 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8f89e27a-50ea-436c-8749-e1772fab9923 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:48.296188 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8f89e27a-50ea-436c-8749-e1772fab9923 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:48.296649 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8f89e27a-50ea-436c-8749-e1772fab9923 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:48.446666 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8f89e27a-50ea-436c-8749-e1772fab9923 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:48.454942 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8f89e27a-50ea-436c-8749-e1772fab9923 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:48.456766 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8f89e27a-50ea-436c-8749-e1772fab9923 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:48.457855 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-8f89e27a-50ea-436c-8749-e1772fab9923 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1405 microversion: 2.20 time: 0.173990 Jun 07 14:30:48.458421 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 460/886] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:30:48 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:30:49.476511 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-cd56ef46-d9fe-4965-92eb-023b9c56a1ef tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:30:49.477136 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-cd56ef46-d9fe-4965-92eb-023b9c56a1ef tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:30:49.483653 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cd56ef46-d9fe-4965-92eb-023b9c56a1ef tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:49.484106 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cd56ef46-d9fe-4965-92eb-023b9c56a1ef tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:49.484876 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cd56ef46-d9fe-4965-92eb-023b9c56a1ef tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:49.485318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cd56ef46-d9fe-4965-92eb-023b9c56a1ef tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:49.616098 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-cd56ef46-d9fe-4965-92eb-023b9c56a1ef tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:49.624631 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-cd56ef46-d9fe-4965-92eb-023b9c56a1ef tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:49.626241 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-cd56ef46-d9fe-4965-92eb-023b9c56a1ef tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:49.627574 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-cd56ef46-d9fe-4965-92eb-023b9c56a1ef tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1405 microversion: 2.20 time: 0.155025 Jun 07 14:30:49.628331 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 427/887] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:30:49 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:30:50.645188 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-e867f230-ff2b-4103-9b5b-d401ec422875 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:30:50.645805 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-e867f230-ff2b-4103-9b5b-d401ec422875 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:30:50.652254 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e867f230-ff2b-4103-9b5b-d401ec422875 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:50.652706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e867f230-ff2b-4103-9b5b-d401ec422875 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:50.653468 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e867f230-ff2b-4103-9b5b-d401ec422875 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:50.653944 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e867f230-ff2b-4103-9b5b-d401ec422875 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:50.780089 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-e867f230-ff2b-4103-9b5b-d401ec422875 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:50.788177 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-e867f230-ff2b-4103-9b5b-d401ec422875 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:50.789692 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-e867f230-ff2b-4103-9b5b-d401ec422875 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:50.790793 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-e867f230-ff2b-4103-9b5b-d401ec422875 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1405 microversion: 2.20 time: 0.149505 Jun 07 14:30:50.791384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 461/888] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:30:50 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:30:51.057915 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-6502c004-8aeb-4dba-8330-dd0ced179d74 req-92d909b5-dc93-4969-9a8e-0c6f1cafdf2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff2cef5f-a25c-4fa4-b34e-85da9efbdca8", "name": "network-vif-plugged", "status": "completed", "tag": "6a66cc9b-a903-4e8e-8ab2-720990265484"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:30:51.068511 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-6502c004-8aeb-4dba-8330-dd0ced179d74 req-92d909b5-dc93-4969-9a8e-0c6f1cafdf2c service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:51.068974 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-6502c004-8aeb-4dba-8330-dd0ced179d74 req-92d909b5-dc93-4969-9a8e-0c6f1cafdf2c service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:51.081229 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-6502c004-8aeb-4dba-8330-dd0ced179d74 req-92d909b5-dc93-4969-9a8e-0c6f1cafdf2c service nova] Creating event network-vif-plugged:6a66cc9b-a903-4e8e-8ab2-720990265484 for instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 on hv-cinder-83608 Jun 07 14:30:51.086274 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-6502c004-8aeb-4dba-8330-dd0ced179d74 req-92d909b5-dc93-4969-9a8e-0c6f1cafdf2c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032166 Jun 07 14:30:51.086943 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 428/889] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:30:51.813594 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-b2c48a7c-8211-4845-9a64-9a8036c76a42 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:30:51.814416 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-b2c48a7c-8211-4845-9a64-9a8036c76a42 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:30:51.820989 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b2c48a7c-8211-4845-9a64-9a8036c76a42 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:51.821441 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b2c48a7c-8211-4845-9a64-9a8036c76a42 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:51.822203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b2c48a7c-8211-4845-9a64-9a8036c76a42 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:51.822641 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b2c48a7c-8211-4845-9a64-9a8036c76a42 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:51.954337 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-b2c48a7c-8211-4845-9a64-9a8036c76a42 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:51.963064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-b2c48a7c-8211-4845-9a64-9a8036c76a42 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:51.964639 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-b2c48a7c-8211-4845-9a64-9a8036c76a42 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:51.965770 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-b2c48a7c-8211-4845-9a64-9a8036c76a42 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1405 microversion: 2.20 time: 0.156206 Jun 07 14:30:51.966335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 462/890] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:30:51 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:30:52.985180 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1a258c90-f2ff-45f8-8006-67dadc065082 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:30:52.986490 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1a258c90-f2ff-45f8-8006-67dadc065082 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:30:52.989236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:30:52.991091 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=6 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:30:52.999714 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1a258c90-f2ff-45f8-8006-67dadc065082 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:53.000163 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1a258c90-f2ff-45f8-8006-67dadc065082 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:53.000946 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1a258c90-f2ff-45f8-8006-67dadc065082 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:53.001456 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1a258c90-f2ff-45f8-8006-67dadc065082 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:53.142363 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1a258c90-f2ff-45f8-8006-67dadc065082 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:53.150249 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1a258c90-f2ff-45f8-8006-67dadc065082 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:53.151814 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1a258c90-f2ff-45f8-8006-67dadc065082 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:30:53.152989 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1a258c90-f2ff-45f8-8006-67dadc065082 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1596 microversion: 2.20 time: 0.172041 Jun 07 14:30:53.153546 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 429/891] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:30:52 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1596 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:30:53.170780 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-a7cea5a1-9a9d-4d6d-bf25-4886109ba5dd tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:30:53.171300 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-a7cea5a1-9a9d-4d6d-bf25-4886109ba5dd tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:30:53.179546 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=6 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:30:53.182153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a7cea5a1-9a9d-4d6d-bf25-4886109ba5dd tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:53.182607 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a7cea5a1-9a9d-4d6d-bf25-4886109ba5dd tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:53.183436 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a7cea5a1-9a9d-4d6d-bf25-4886109ba5dd tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:53.183900 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a7cea5a1-9a9d-4d6d-bf25-4886109ba5dd tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:53.265703 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-a7cea5a1-9a9d-4d6d-bf25-4886109ba5dd tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098790 Jun 07 14:30:53.266766 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 463/892] 10.222.0.81 () {60 vars in 1315 bytes} [Tue Jun 7 14:30:53 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:30:54.177814 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-0a5776f9-0f74-4057-9ad2-332d4bbc1490 req-336fda55-1ea6-4639-bc54-10c0dd5338e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff2cef5f-a25c-4fa4-b34e-85da9efbdca8", "tag": "6a66cc9b-a903-4e8e-8ab2-720990265484"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:30:54.186378 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-0a5776f9-0f74-4057-9ad2-332d4bbc1490 req-336fda55-1ea6-4639-bc54-10c0dd5338e9 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:54.186814 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-0a5776f9-0f74-4057-9ad2-332d4bbc1490 req-336fda55-1ea6-4639-bc54-10c0dd5338e9 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:54.198624 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-0a5776f9-0f74-4057-9ad2-332d4bbc1490 req-336fda55-1ea6-4639-bc54-10c0dd5338e9 service nova] Creating event network-changed:6a66cc9b-a903-4e8e-8ab2-720990265484 for instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 on hv-cinder-83608 Jun 07 14:30:54.203448 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-0a5776f9-0f74-4057-9ad2-332d4bbc1490 req-336fda55-1ea6-4639-bc54-10c0dd5338e9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029700 Jun 07 14:30:54.204046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 430/893] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:31:29.982194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:29.983023 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:29.987769 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-add8bd79-2f24-4021-a71c-75d0048dcfeb tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:29.988359 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-add8bd79-2f24-4021-a71c-75d0048dcfeb tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:29.995880 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-add8bd79-2f24-4021-a71c-75d0048dcfeb tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:29.996454 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-add8bd79-2f24-4021-a71c-75d0048dcfeb tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:29.997227 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-add8bd79-2f24-4021-a71c-75d0048dcfeb tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:29.997666 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-add8bd79-2f24-4021-a71c-75d0048dcfeb tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:30.022395 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-add8bd79-2f24-4021-a71c-75d0048dcfeb tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8/ips" status: 200 len: 151 microversion: 2.20 time: 0.041534 Jun 07 14:31:30.023148 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 464/894] 10.222.0.81 () {60 vars in 1288 bytes} [Tue Jun 7 14:31:29 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:31:31.787245 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:31.787978 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:31.792208 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0459b542-af5f-4c85-a4ab-6a73d693d60a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:31:31.792821 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0459b542-af5f-4c85-a4ab-6a73d693d60a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:31.800297 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0459b542-af5f-4c85-a4ab-6a73d693d60a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:31.800743 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0459b542-af5f-4c85-a4ab-6a73d693d60a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:31.801852 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0459b542-af5f-4c85-a4ab-6a73d693d60a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:31.802287 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0459b542-af5f-4c85-a4ab-6a73d693d60a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:31.826624 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-0459b542-af5f-4c85-a4ab-6a73d693d60a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lazy-loading 'flavor' on Instance uuid ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:31:32.256142 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0459b542-af5f-4c85-a4ab-6a73d693d60a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "POST /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8/action" status: 202 len: 0 microversion: 2.20 time: 0.471053 Jun 07 14:31:32.256876 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 431/895] 10.222.0.81 () {62 vars in 1318 bytes} [Tue Jun 7 14:31:31 2022] POST /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:31:32.265070 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-38a4f685-e2e4-4a14-8bdd-9508a955f84a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:32.265687 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-38a4f685-e2e4-4a14-8bdd-9508a955f84a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:32.273142 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-38a4f685-e2e4-4a14-8bdd-9508a955f84a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:32.273769 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-38a4f685-e2e4-4a14-8bdd-9508a955f84a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:32.274712 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-38a4f685-e2e4-4a14-8bdd-9508a955f84a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:32.275211 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-38a4f685-e2e4-4a14-8bdd-9508a955f84a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:32.504927 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-38a4f685-e2e4-4a14-8bdd-9508a955f84a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:32.512889 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-38a4f685-e2e4-4a14-8bdd-9508a955f84a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:32.514402 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-38a4f685-e2e4-4a14-8bdd-9508a955f84a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:32.515596 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-38a4f685-e2e4-4a14-8bdd-9508a955f84a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1721 microversion: 2.20 time: 0.254520 Jun 07 14:31:32.516155 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 465/896] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:31:32 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1721 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:31:33.534932 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-99104838-181d-42d6-9f03-b1b72f2180b1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:33.535954 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-99104838-181d-42d6-9f03-b1b72f2180b1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:33.542276 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-99104838-181d-42d6-9f03-b1b72f2180b1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:33.542718 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-99104838-181d-42d6-9f03-b1b72f2180b1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:33.543507 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-99104838-181d-42d6-9f03-b1b72f2180b1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:33.543940 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-99104838-181d-42d6-9f03-b1b72f2180b1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:33.673751 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-99104838-181d-42d6-9f03-b1b72f2180b1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:33.681952 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-99104838-181d-42d6-9f03-b1b72f2180b1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:33.683476 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-99104838-181d-42d6-9f03-b1b72f2180b1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:33.684624 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-99104838-181d-42d6-9f03-b1b72f2180b1 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1721 microversion: 2.20 time: 0.154478 Jun 07 14:31:33.685173 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 432/897] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:31:33 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:31:34.704069 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-742d19d2-fbdc-4f9c-83b1-d1c267fb519d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:34.704686 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-742d19d2-fbdc-4f9c-83b1-d1c267fb519d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:34.711749 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-742d19d2-fbdc-4f9c-83b1-d1c267fb519d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:34.712203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-742d19d2-fbdc-4f9c-83b1-d1c267fb519d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:34.712969 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-742d19d2-fbdc-4f9c-83b1-d1c267fb519d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:34.713410 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-742d19d2-fbdc-4f9c-83b1-d1c267fb519d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:34.845924 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-742d19d2-fbdc-4f9c-83b1-d1c267fb519d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:34.854341 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-742d19d2-fbdc-4f9c-83b1-d1c267fb519d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:34.855907 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-742d19d2-fbdc-4f9c-83b1-d1c267fb519d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:34.857059 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-742d19d2-fbdc-4f9c-83b1-d1c267fb519d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1721 microversion: 2.20 time: 0.156957 Jun 07 14:31:34.857617 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 466/898] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:31:34 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:31:35.875588 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-58960ac9-dd97-4a21-a67d-18b23a0956d6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:35.876199 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-58960ac9-dd97-4a21-a67d-18b23a0956d6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:35.882868 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-58960ac9-dd97-4a21-a67d-18b23a0956d6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:35.883348 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-58960ac9-dd97-4a21-a67d-18b23a0956d6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:35.884112 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-58960ac9-dd97-4a21-a67d-18b23a0956d6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:35.884548 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-58960ac9-dd97-4a21-a67d-18b23a0956d6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:36.011069 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-58960ac9-dd97-4a21-a67d-18b23a0956d6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:36.018892 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-58960ac9-dd97-4a21-a67d-18b23a0956d6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:36.021052 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-58960ac9-dd97-4a21-a67d-18b23a0956d6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:36.022208 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-58960ac9-dd97-4a21-a67d-18b23a0956d6 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1721 microversion: 2.20 time: 0.150624 Jun 07 14:31:36.022766 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 433/899] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:31:35 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:31:37.040819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-8dece520-b58a-404f-93e6-f88f3c856857 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:37.041428 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-8dece520-b58a-404f-93e6-f88f3c856857 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:37.047901 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8dece520-b58a-404f-93e6-f88f3c856857 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:37.048354 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8dece520-b58a-404f-93e6-f88f3c856857 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:37.049116 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8dece520-b58a-404f-93e6-f88f3c856857 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:37.049553 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8dece520-b58a-404f-93e6-f88f3c856857 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:37.179086 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8dece520-b58a-404f-93e6-f88f3c856857 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:37.187012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8dece520-b58a-404f-93e6-f88f3c856857 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:37.188638 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8dece520-b58a-404f-93e6-f88f3c856857 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:37.189782 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-8dece520-b58a-404f-93e6-f88f3c856857 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1721 microversion: 2.20 time: 0.152888 Jun 07 14:31:37.190350 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 467/900] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:31:37 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:31:38.208174 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c81cd796-9591-4eae-9434-9ded07aba5f7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:38.208848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c81cd796-9591-4eae-9434-9ded07aba5f7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:38.217158 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c81cd796-9591-4eae-9434-9ded07aba5f7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:38.217605 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c81cd796-9591-4eae-9434-9ded07aba5f7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:38.218372 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c81cd796-9591-4eae-9434-9ded07aba5f7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:38.219071 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c81cd796-9591-4eae-9434-9ded07aba5f7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:38.352252 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c81cd796-9591-4eae-9434-9ded07aba5f7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:38.360064 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c81cd796-9591-4eae-9434-9ded07aba5f7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:38.361572 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c81cd796-9591-4eae-9434-9ded07aba5f7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:38.362724 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c81cd796-9591-4eae-9434-9ded07aba5f7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1721 microversion: 2.20 time: 0.158727 Jun 07 14:31:38.364184 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 434/901] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:31:38 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:31:39.381667 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-f746353b-d0d1-4f99-89a7-9858a9c97063 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:39.382269 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-f746353b-d0d1-4f99-89a7-9858a9c97063 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:39.388927 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f746353b-d0d1-4f99-89a7-9858a9c97063 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:39.389385 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f746353b-d0d1-4f99-89a7-9858a9c97063 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:39.390147 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f746353b-d0d1-4f99-89a7-9858a9c97063 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:39.390583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f746353b-d0d1-4f99-89a7-9858a9c97063 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:39.522236 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-f746353b-d0d1-4f99-89a7-9858a9c97063 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:39.530791 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-f746353b-d0d1-4f99-89a7-9858a9c97063 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:39.532371 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-f746353b-d0d1-4f99-89a7-9858a9c97063 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:39.533536 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-f746353b-d0d1-4f99-89a7-9858a9c97063 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1721 microversion: 2.20 time: 0.156635 Jun 07 14:31:39.534105 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 468/902] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:31:39 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:31:40.551873 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9bf028ca-7e4c-47c8-9941-4ab2bba7e9f0 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:40.552490 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9bf028ca-7e4c-47c8-9941-4ab2bba7e9f0 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:40.558891 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9bf028ca-7e4c-47c8-9941-4ab2bba7e9f0 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:40.559377 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9bf028ca-7e4c-47c8-9941-4ab2bba7e9f0 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:40.560132 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9bf028ca-7e4c-47c8-9941-4ab2bba7e9f0 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:40.560564 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9bf028ca-7e4c-47c8-9941-4ab2bba7e9f0 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:40.694791 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9bf028ca-7e4c-47c8-9941-4ab2bba7e9f0 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:40.702594 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9bf028ca-7e4c-47c8-9941-4ab2bba7e9f0 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:40.704144 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9bf028ca-7e4c-47c8-9941-4ab2bba7e9f0 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:40.705298 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9bf028ca-7e4c-47c8-9941-4ab2bba7e9f0 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1721 microversion: 2.20 time: 0.157605 Jun 07 14:31:40.705849 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 435/903] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:31:40 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:31:41.724762 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-9dd8b5cc-667c-42dc-ba82-9f7f9ccefbe4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:41.725416 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-9dd8b5cc-667c-42dc-ba82-9f7f9ccefbe4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:41.732162 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9dd8b5cc-667c-42dc-ba82-9f7f9ccefbe4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:41.732610 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9dd8b5cc-667c-42dc-ba82-9f7f9ccefbe4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:41.733371 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9dd8b5cc-667c-42dc-ba82-9f7f9ccefbe4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:41.733814 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-9dd8b5cc-667c-42dc-ba82-9f7f9ccefbe4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:41.862688 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-9dd8b5cc-667c-42dc-ba82-9f7f9ccefbe4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:41.870732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-9dd8b5cc-667c-42dc-ba82-9f7f9ccefbe4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:41.872271 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-9dd8b5cc-667c-42dc-ba82-9f7f9ccefbe4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:41.873426 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-9dd8b5cc-667c-42dc-ba82-9f7f9ccefbe4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1721 microversion: 2.20 time: 0.153095 Jun 07 14:31:41.873986 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 469/904] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:31:41 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:31:42.891514 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c0f90053-1d1b-4ea0-9283-d29537215de7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:42.892167 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c0f90053-1d1b-4ea0-9283-d29537215de7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:42.898888 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c0f90053-1d1b-4ea0-9283-d29537215de7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:42.899586 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c0f90053-1d1b-4ea0-9283-d29537215de7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:42.900365 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c0f90053-1d1b-4ea0-9283-d29537215de7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:42.900809 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c0f90053-1d1b-4ea0-9283-d29537215de7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:43.027749 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c0f90053-1d1b-4ea0-9283-d29537215de7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:43.037309 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c0f90053-1d1b-4ea0-9283-d29537215de7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:43.038948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c0f90053-1d1b-4ea0-9283-d29537215de7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:43.040152 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c0f90053-1d1b-4ea0-9283-d29537215de7 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1721 microversion: 2.20 time: 0.152656 Jun 07 14:31:43.040714 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 436/905] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:31:42 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:31:43.284636 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-8d9c730c-fd0b-4b48-a0cd-43a021b8217c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1440696175", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-234910173", "security_groups": [{"name": "tempest-secgroup-smoke-1262891354"}], "block_device_mapping_v2": [{"uuid": "f4ea0ed8-ada9-4a1f-9520-adef45524ea3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2c006233-0519-428c-b750-6c5e4d46a20e"}]}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:31:43.397572 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.network.neutron [None req-8d9c730c-fd0b-4b48-a0cd-43a021b8217c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] validate_networks() for [('2c006233-0519-428c-b750-6c5e4d46a20e', None, None, None, None, None)] {{(pid=117565) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:31:43.778777 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-8d9c730c-fd0b-4b48-a0cd-43a021b8217c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Flavor limits 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:31:43.779206 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-8d9c730c-fd0b-4b48-a0cd-43a021b8217c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Image limits 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:31:43.779733 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-8d9c730c-fd0b-4b48-a0cd-43a021b8217c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Flavor pref 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:31:43.780146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-8d9c730c-fd0b-4b48-a0cd-43a021b8217c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Image pref 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:31:43.780560 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-8d9c730c-fd0b-4b48-a0cd-43a021b8217c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:31:43.789300 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8d9c730c-fd0b-4b48-a0cd-43a021b8217c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:43.789749 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8d9c730c-fd0b-4b48-a0cd-43a021b8217c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:43.790551 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8d9c730c-fd0b-4b48-a0cd-43a021b8217c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:43.790988 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8d9c730c-fd0b-4b48-a0cd-43a021b8217c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:43.807735 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-8d9c730c-fd0b-4b48-a0cd-43a021b8217c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Getting quotas for project 6ee52855d08e467f9d2f02685d7bf541. Resources: {'ram', 'cores', 'instances'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:31:43.812025 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-8d9c730c-fd0b-4b48-a0cd-43a021b8217c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Getting quotas for user d0b828a3dca14f2283a16894364d6eef and project 6ee52855d08e467f9d2f02685d7bf541. Resources: {'ram', 'cores', 'instances'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:31:43.868736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-8d9c730c-fd0b-4b48-a0cd-43a021b8217c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Going to run 1 instances... {{(pid=117565) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:31:43.870866 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-8d9c730c-fd0b-4b48-a0cd-43a021b8217c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 25aa543f-396c-46d5-a8b6-2eb21e172198] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f4ea0ed8-ada9-4a1f-9520-adef45524ea3',volume_size=None,volume_type=None)] {{(pid=117565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:31:43.998812 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-8d9c730c-fd0b-4b48-a0cd-43a021b8217c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.717975 Jun 07 14:31:44.005194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 470/906] 10.222.0.81 () {60 vars in 1146 bytes} [Tue Jun 7 14:31:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:31:44.010608 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-aea890d2-5a9a-4f45-95cc-f5598488deaa tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:44.011287 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-aea890d2-5a9a-4f45-95cc-f5598488deaa tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 25aa543f-396c-46d5-a8b6-2eb21e172198] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:44.058419 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-780edcc2-536d-4727-a91e-ee98d3c09051 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:44.059046 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-780edcc2-536d-4727-a91e-ee98d3c09051 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:44.066094 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-780edcc2-536d-4727-a91e-ee98d3c09051 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:44.066310 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-780edcc2-536d-4727-a91e-ee98d3c09051 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:44.067887 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-780edcc2-536d-4727-a91e-ee98d3c09051 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:44.068334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-780edcc2-536d-4727-a91e-ee98d3c09051 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:44.340557 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-aea890d2-5a9a-4f45-95cc-f5598488deaa tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:44.351963 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-aea890d2-5a9a-4f45-95cc-f5598488deaa tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198" status: 200 len: 1094 microversion: 2.1 time: 0.345173 Jun 07 14:31:44.352712 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 437/907] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:31:44 2022] GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198 => generated 1094 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:31:44.435689 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-780edcc2-536d-4727-a91e-ee98d3c09051 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:44.444916 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-780edcc2-536d-4727-a91e-ee98d3c09051 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:44.446545 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-780edcc2-536d-4727-a91e-ee98d3c09051 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:44.447779 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-780edcc2-536d-4727-a91e-ee98d3c09051 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1721 microversion: 2.20 time: 0.393493 Jun 07 14:31:44.448340 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 471/908] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:31:44 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1721 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:31:45.370870 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d55f62a9-da19-482f-a2b4-89b86d9d7aa0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:45.372152 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d55f62a9-da19-482f-a2b4-89b86d9d7aa0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 25aa543f-396c-46d5-a8b6-2eb21e172198] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:45.380242 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d55f62a9-da19-482f-a2b4-89b86d9d7aa0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:45.380689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d55f62a9-da19-482f-a2b4-89b86d9d7aa0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:45.381465 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d55f62a9-da19-482f-a2b4-89b86d9d7aa0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:45.382031 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d55f62a9-da19-482f-a2b4-89b86d9d7aa0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:45.451544 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-d55f62a9-da19-482f-a2b4-89b86d9d7aa0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:45.461086 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d55f62a9-da19-482f-a2b4-89b86d9d7aa0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198" status: 200 len: 1210 microversion: 2.1 time: 0.093602 Jun 07 14:31:45.461682 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 438/909] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:31:45 2022] GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198 => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:31:45.466321 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-a3c7a354-9356-4c2a-a148-bc605b681aa2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:45.469930 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-a3c7a354-9356-4c2a-a148-bc605b681aa2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:45.481600 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a3c7a354-9356-4c2a-a148-bc605b681aa2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:45.482142 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a3c7a354-9356-4c2a-a148-bc605b681aa2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:45.483031 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a3c7a354-9356-4c2a-a148-bc605b681aa2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:45.483561 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a3c7a354-9356-4c2a-a148-bc605b681aa2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:45.645318 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-a3c7a354-9356-4c2a-a148-bc605b681aa2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:45.655200 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-a3c7a354-9356-4c2a-a148-bc605b681aa2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:45.657508 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-a3c7a354-9356-4c2a-a148-bc605b681aa2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:45.658715 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-a3c7a354-9356-4c2a-a148-bc605b681aa2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1721 microversion: 2.20 time: 0.196482 Jun 07 14:31:45.659312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 472/910] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:31:45 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:31:46.480131 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-02846b5e-d412-4e4e-9fe7-e2f32a6ae645 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:46.481811 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-02846b5e-d412-4e4e-9fe7-e2f32a6ae645 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 25aa543f-396c-46d5-a8b6-2eb21e172198] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:46.487002 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-02846b5e-d412-4e4e-9fe7-e2f32a6ae645 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:46.487481 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-02846b5e-d412-4e4e-9fe7-e2f32a6ae645 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:46.488476 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-02846b5e-d412-4e4e-9fe7-e2f32a6ae645 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:46.489093 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-02846b5e-d412-4e4e-9fe7-e2f32a6ae645 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:46.590447 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-be6d37c4-72d2-4b50-b3b7-a981746c1b39 req-18a5c2c5-3412-425e-8b5a-525b562e3f58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25aa543f-396c-46d5-a8b6-2eb21e172198", "tag": "2122f609-8a6d-4e5d-bfcb-9d9443103453"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:31:46.610008 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-be6d37c4-72d2-4b50-b3b7-a981746c1b39 req-18a5c2c5-3412-425e-8b5a-525b562e3f58 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:46.610703 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-be6d37c4-72d2-4b50-b3b7-a981746c1b39 req-18a5c2c5-3412-425e-8b5a-525b562e3f58 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:46.622703 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-be6d37c4-72d2-4b50-b3b7-a981746c1b39 req-18a5c2c5-3412-425e-8b5a-525b562e3f58 service nova] Creating event network-changed:2122f609-8a6d-4e5d-bfcb-9d9443103453 for instance 25aa543f-396c-46d5-a8b6-2eb21e172198 on hv-cinder-83608 Jun 07 14:31:46.628021 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-be6d37c4-72d2-4b50-b3b7-a981746c1b39 req-18a5c2c5-3412-425e-8b5a-525b562e3f58 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152546 Jun 07 14:31:46.628879 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 473/911] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:31:46.674060 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-02846b5e-d412-4e4e-9fe7-e2f32a6ae645 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:46.678194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ff09da0a-e7d1-407c-8a8a-41f40b324be8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:46.678837 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ff09da0a-e7d1-407c-8a8a-41f40b324be8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:46.683857 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-02846b5e-d412-4e4e-9fe7-e2f32a6ae645 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198" status: 200 len: 1266 microversion: 2.1 time: 0.209699 Jun 07 14:31:46.687169 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 439/912] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:31:46 2022] GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:31:46.687335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ff09da0a-e7d1-407c-8a8a-41f40b324be8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:46.687335 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ff09da0a-e7d1-407c-8a8a-41f40b324be8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:46.687556 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ff09da0a-e7d1-407c-8a8a-41f40b324be8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:46.689237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ff09da0a-e7d1-407c-8a8a-41f40b324be8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:46.828183 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ff09da0a-e7d1-407c-8a8a-41f40b324be8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:46.836172 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ff09da0a-e7d1-407c-8a8a-41f40b324be8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:46.837699 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ff09da0a-e7d1-407c-8a8a-41f40b324be8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:46.838863 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ff09da0a-e7d1-407c-8a8a-41f40b324be8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1721 microversion: 2.20 time: 0.165358 Jun 07 14:31:46.839469 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 474/913] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:31:46 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:31:47.700935 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f3108b9c-493e-4e8b-98f3-7fb148d56f1a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:47.701623 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f3108b9c-493e-4e8b-98f3-7fb148d56f1a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 25aa543f-396c-46d5-a8b6-2eb21e172198] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:47.708680 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f3108b9c-493e-4e8b-98f3-7fb148d56f1a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:47.709134 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f3108b9c-493e-4e8b-98f3-7fb148d56f1a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:47.710018 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f3108b9c-493e-4e8b-98f3-7fb148d56f1a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:47.710425 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f3108b9c-493e-4e8b-98f3-7fb148d56f1a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:47.845794 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f3108b9c-493e-4e8b-98f3-7fb148d56f1a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:47.853981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f3108b9c-493e-4e8b-98f3-7fb148d56f1a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198" status: 200 len: 1266 microversion: 2.1 time: 0.156873 Jun 07 14:31:47.854557 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 440/914] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:31:47 2022] GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:31:47.856850 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d4999bde-c1aa-40e3-8cfd-31fa18518b40 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:47.857506 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-d4999bde-c1aa-40e3-8cfd-31fa18518b40 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:47.864376 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d4999bde-c1aa-40e3-8cfd-31fa18518b40 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:47.864944 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d4999bde-c1aa-40e3-8cfd-31fa18518b40 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:47.865662 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d4999bde-c1aa-40e3-8cfd-31fa18518b40 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:47.866102 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d4999bde-c1aa-40e3-8cfd-31fa18518b40 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:47.996783 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-d4999bde-c1aa-40e3-8cfd-31fa18518b40 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:48.005293 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-d4999bde-c1aa-40e3-8cfd-31fa18518b40 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:48.006947 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-d4999bde-c1aa-40e3-8cfd-31fa18518b40 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:48.008134 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-d4999bde-c1aa-40e3-8cfd-31fa18518b40 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1742 microversion: 2.20 time: 0.155198 Jun 07 14:31:48.008698 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 475/915] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:31:47 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:31:48.870036 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6af7d4e7-2c5b-4560-aa6b-e11423fb0476 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:48.870674 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-6af7d4e7-2c5b-4560-aa6b-e11423fb0476 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 25aa543f-396c-46d5-a8b6-2eb21e172198] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:48.877102 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6af7d4e7-2c5b-4560-aa6b-e11423fb0476 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:48.877546 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6af7d4e7-2c5b-4560-aa6b-e11423fb0476 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:48.878302 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6af7d4e7-2c5b-4560-aa6b-e11423fb0476 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:48.878738 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6af7d4e7-2c5b-4560-aa6b-e11423fb0476 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:49.009858 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-6af7d4e7-2c5b-4560-aa6b-e11423fb0476 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:49.017398 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6af7d4e7-2c5b-4560-aa6b-e11423fb0476 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198" status: 200 len: 1266 microversion: 2.1 time: 0.151192 Jun 07 14:31:49.017963 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 441/916] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:31:48 2022] GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:31:49.025811 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-aa6da54f-e306-42c8-978c-f881f0ac342a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:49.026469 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-aa6da54f-e306-42c8-978c-f881f0ac342a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:49.032940 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-aa6da54f-e306-42c8-978c-f881f0ac342a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:49.033396 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-aa6da54f-e306-42c8-978c-f881f0ac342a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:49.034180 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-aa6da54f-e306-42c8-978c-f881f0ac342a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:49.034695 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-aa6da54f-e306-42c8-978c-f881f0ac342a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:49.164487 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-aa6da54f-e306-42c8-978c-f881f0ac342a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:49.173038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-aa6da54f-e306-42c8-978c-f881f0ac342a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:49.174554 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-aa6da54f-e306-42c8-978c-f881f0ac342a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:49.175761 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-aa6da54f-e306-42c8-978c-f881f0ac342a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1742 microversion: 2.20 time: 0.153870 Jun 07 14:31:49.176884 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 476/917] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:31:49 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:31:50.034003 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9471b07a-98df-4316-91cd-06d1073727b5 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:50.034731 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9471b07a-98df-4316-91cd-06d1073727b5 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 25aa543f-396c-46d5-a8b6-2eb21e172198] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:50.042797 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9471b07a-98df-4316-91cd-06d1073727b5 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:50.044445 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9471b07a-98df-4316-91cd-06d1073727b5 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:50.045249 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9471b07a-98df-4316-91cd-06d1073727b5 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:50.045696 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9471b07a-98df-4316-91cd-06d1073727b5 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:50.195040 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-130d071d-28ee-4d4e-a069-a41422bdef4e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:50.195646 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9471b07a-98df-4316-91cd-06d1073727b5 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:50.196629 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-130d071d-28ee-4d4e-a069-a41422bdef4e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:50.204143 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-130d071d-28ee-4d4e-a069-a41422bdef4e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:50.204589 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-130d071d-28ee-4d4e-a069-a41422bdef4e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:50.205685 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-130d071d-28ee-4d4e-a069-a41422bdef4e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:50.206160 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9471b07a-98df-4316-91cd-06d1073727b5 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198" status: 200 len: 1266 microversion: 2.1 time: 0.176015 Jun 07 14:31:50.206294 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-130d071d-28ee-4d4e-a069-a41422bdef4e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:50.206748 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 442/918] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:31:50 2022] GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:31:50.346838 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-130d071d-28ee-4d4e-a069-a41422bdef4e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:50.354955 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-130d071d-28ee-4d4e-a069-a41422bdef4e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:50.356479 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-130d071d-28ee-4d4e-a069-a41422bdef4e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:50.357627 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-130d071d-28ee-4d4e-a069-a41422bdef4e tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1737 microversion: 2.20 time: 0.167760 Jun 07 14:31:50.358178 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 477/919] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:31:50 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:31:51.223190 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-dc131e59-a034-43f0-b238-90811bf58ef7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:51.225110 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-dc131e59-a034-43f0-b238-90811bf58ef7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 25aa543f-396c-46d5-a8b6-2eb21e172198] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:51.234071 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dc131e59-a034-43f0-b238-90811bf58ef7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:51.234906 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dc131e59-a034-43f0-b238-90811bf58ef7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:51.235988 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dc131e59-a034-43f0-b238-90811bf58ef7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:51.236702 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-dc131e59-a034-43f0-b238-90811bf58ef7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:51.361449 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-8004131b-fe57-4e80-bf7b-a6ccc02b170b req-99601914-b9d8-409d-abf1-115218d8dd98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff2cef5f-a25c-4fa4-b34e-85da9efbdca8", "name": "network-vif-plugged", "status": "completed", "tag": "6a66cc9b-a903-4e8e-8ab2-720990265484"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:31:51.380341 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-8004131b-fe57-4e80-bf7b-a6ccc02b170b req-99601914-b9d8-409d-abf1-115218d8dd98 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:51.381768 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-8004131b-fe57-4e80-bf7b-a6ccc02b170b req-99601914-b9d8-409d-abf1-115218d8dd98 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:51.404218 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-dc131e59-a034-43f0-b238-90811bf58ef7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:51.405633 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-8004131b-fe57-4e80-bf7b-a6ccc02b170b req-99601914-b9d8-409d-abf1-115218d8dd98 service nova] Creating event network-vif-plugged:6a66cc9b-a903-4e8e-8ab2-720990265484 for instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 on hv-cinder-83608 Jun 07 14:31:51.413413 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-8004131b-fe57-4e80-bf7b-a6ccc02b170b req-99601914-b9d8-409d-abf1-115218d8dd98 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055839 Jun 07 14:31:51.414641 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 478/920] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:31:51.418186 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-dc131e59-a034-43f0-b238-90811bf58ef7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198" status: 200 len: 1266 microversion: 2.1 time: 0.198965 Jun 07 14:31:51.432407 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 443/921] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:31:51 2022] GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:31:51.437074 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-8e6e3d58-ca2a-446e-9fc0-1562668d15d2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:51.438004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-8e6e3d58-ca2a-446e-9fc0-1562668d15d2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:51.446486 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8e6e3d58-ca2a-446e-9fc0-1562668d15d2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:51.446941 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8e6e3d58-ca2a-446e-9fc0-1562668d15d2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:51.447821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8e6e3d58-ca2a-446e-9fc0-1562668d15d2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:51.448440 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8e6e3d58-ca2a-446e-9fc0-1562668d15d2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:51.596914 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8e6e3d58-ca2a-446e-9fc0-1562668d15d2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:51.607200 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8e6e3d58-ca2a-446e-9fc0-1562668d15d2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:51.608775 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8e6e3d58-ca2a-446e-9fc0-1562668d15d2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:51.609983 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-8e6e3d58-ca2a-446e-9fc0-1562668d15d2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1737 microversion: 2.20 time: 0.193982 Jun 07 14:31:51.610792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 479/922] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:31:51 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1737 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:31:52.438419 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3e8560a4-9e13-4137-a5ae-79bf7dbd4fbe tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:52.439721 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3e8560a4-9e13-4137-a5ae-79bf7dbd4fbe tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 25aa543f-396c-46d5-a8b6-2eb21e172198] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:52.446623 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3e8560a4-9e13-4137-a5ae-79bf7dbd4fbe tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:52.447073 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3e8560a4-9e13-4137-a5ae-79bf7dbd4fbe tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:52.447881 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3e8560a4-9e13-4137-a5ae-79bf7dbd4fbe tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:52.448320 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3e8560a4-9e13-4137-a5ae-79bf7dbd4fbe tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:52.603770 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3e8560a4-9e13-4137-a5ae-79bf7dbd4fbe tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:52.614022 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3e8560a4-9e13-4137-a5ae-79bf7dbd4fbe tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198" status: 200 len: 1266 microversion: 2.1 time: 0.179402 Jun 07 14:31:52.614998 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 444/923] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:31:52 2022] GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:31:52.629183 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-4eb1f1cc-5ef7-4975-8fa3-31bfe482426c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:52.630598 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-4eb1f1cc-5ef7-4975-8fa3-31bfe482426c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:52.640797 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4eb1f1cc-5ef7-4975-8fa3-31bfe482426c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:52.641216 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4eb1f1cc-5ef7-4975-8fa3-31bfe482426c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:52.641977 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4eb1f1cc-5ef7-4975-8fa3-31bfe482426c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:52.642477 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4eb1f1cc-5ef7-4975-8fa3-31bfe482426c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:52.824026 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-4eb1f1cc-5ef7-4975-8fa3-31bfe482426c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:52.834246 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-4eb1f1cc-5ef7-4975-8fa3-31bfe482426c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:52.836146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-4eb1f1cc-5ef7-4975-8fa3-31bfe482426c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:52.837360 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-4eb1f1cc-5ef7-4975-8fa3-31bfe482426c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1737 microversion: 2.20 time: 0.212215 Jun 07 14:31:52.837934 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 480/924] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:31:52 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:31:53.631005 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a5f4bd82-ec6c-4469-bcaa-bbb699989e9d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:53.631816 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a5f4bd82-ec6c-4469-bcaa-bbb699989e9d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 25aa543f-396c-46d5-a8b6-2eb21e172198] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:53.638826 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a5f4bd82-ec6c-4469-bcaa-bbb699989e9d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:53.639318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a5f4bd82-ec6c-4469-bcaa-bbb699989e9d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:53.640311 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a5f4bd82-ec6c-4469-bcaa-bbb699989e9d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:53.641054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a5f4bd82-ec6c-4469-bcaa-bbb699989e9d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:53.803620 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a5f4bd82-ec6c-4469-bcaa-bbb699989e9d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:53.811869 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a5f4bd82-ec6c-4469-bcaa-bbb699989e9d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198" status: 200 len: 1266 microversion: 2.1 time: 0.185015 Jun 07 14:31:53.823716 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 445/925] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:31:53 2022] GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:31:53.856333 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-beadb87c-d924-4336-ad6b-ee19ebb11527 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:53.856936 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-beadb87c-d924-4336-ad6b-ee19ebb11527 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:53.861161 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=2 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:53.862079 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=6 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:53.868037 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-beadb87c-d924-4336-ad6b-ee19ebb11527 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:53.868485 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-beadb87c-d924-4336-ad6b-ee19ebb11527 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:53.869266 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-beadb87c-d924-4336-ad6b-ee19ebb11527 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:53.869702 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-beadb87c-d924-4336-ad6b-ee19ebb11527 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:54.024718 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-beadb87c-d924-4336-ad6b-ee19ebb11527 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:54.038211 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-beadb87c-d924-4336-ad6b-ee19ebb11527 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:54.042297 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-beadb87c-d924-4336-ad6b-ee19ebb11527 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:54.044464 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-beadb87c-d924-4336-ad6b-ee19ebb11527 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1737 microversion: 2.20 time: 0.192568 Jun 07 14:31:54.045047 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 481/926] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:31:53 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:31:54.831025 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b5876756-db7c-4f96-935c-a8903cd847cf tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:54.831608 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b5876756-db7c-4f96-935c-a8903cd847cf tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 25aa543f-396c-46d5-a8b6-2eb21e172198] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:54.835679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:54.840803 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b5876756-db7c-4f96-935c-a8903cd847cf tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:54.841638 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b5876756-db7c-4f96-935c-a8903cd847cf tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:54.842518 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b5876756-db7c-4f96-935c-a8903cd847cf tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:54.843062 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b5876756-db7c-4f96-935c-a8903cd847cf tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:54.872879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:55.023182 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-b5876756-db7c-4f96-935c-a8903cd847cf tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:55.031467 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b5876756-db7c-4f96-935c-a8903cd847cf tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198" status: 200 len: 1266 microversion: 2.1 time: 0.205171 Jun 07 14:31:55.043254 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 446/927] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:31:54 2022] GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:31:55.063711 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-81fa3b96-bc1b-4a57-8afc-fd8bf76cfa23 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:55.065050 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-81fa3b96-bc1b-4a57-8afc-fd8bf76cfa23 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:55.073341 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-81fa3b96-bc1b-4a57-8afc-fd8bf76cfa23 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:55.075042 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-81fa3b96-bc1b-4a57-8afc-fd8bf76cfa23 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:55.075936 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-81fa3b96-bc1b-4a57-8afc-fd8bf76cfa23 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:55.076453 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-81fa3b96-bc1b-4a57-8afc-fd8bf76cfa23 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:55.249067 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-81fa3b96-bc1b-4a57-8afc-fd8bf76cfa23 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:55.253730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=100 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:55.260009 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-81fa3b96-bc1b-4a57-8afc-fd8bf76cfa23 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:55.261706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-81fa3b96-bc1b-4a57-8afc-fd8bf76cfa23 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:55.262915 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-81fa3b96-bc1b-4a57-8afc-fd8bf76cfa23 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1737 microversion: 2.20 time: 0.203560 Jun 07 14:31:55.263837 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 482/928] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:31:55 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:31:56.053632 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ee270e0a-793e-4ccc-83ce-0d1eb92dc2ab tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:56.055017 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ee270e0a-793e-4ccc-83ce-0d1eb92dc2ab tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 25aa543f-396c-46d5-a8b6-2eb21e172198] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:56.061469 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ee270e0a-793e-4ccc-83ce-0d1eb92dc2ab tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:56.061924 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ee270e0a-793e-4ccc-83ce-0d1eb92dc2ab tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:56.062703 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ee270e0a-793e-4ccc-83ce-0d1eb92dc2ab tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:56.063153 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ee270e0a-793e-4ccc-83ce-0d1eb92dc2ab tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:56.219001 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ee270e0a-793e-4ccc-83ce-0d1eb92dc2ab tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:56.228299 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ee270e0a-793e-4ccc-83ce-0d1eb92dc2ab tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198" status: 200 len: 1266 microversion: 2.1 time: 0.181563 Jun 07 14:31:56.229229 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 447/929] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:31:56 2022] GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:31:56.283710 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-493c07ad-54fa-4ed2-8255-f8962a7d066d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:56.284337 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-493c07ad-54fa-4ed2-8255-f8962a7d066d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:56.291972 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-493c07ad-54fa-4ed2-8255-f8962a7d066d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:56.292437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-493c07ad-54fa-4ed2-8255-f8962a7d066d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:56.293374 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-493c07ad-54fa-4ed2-8255-f8962a7d066d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:56.293831 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-493c07ad-54fa-4ed2-8255-f8962a7d066d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:56.446945 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-493c07ad-54fa-4ed2-8255-f8962a7d066d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:56.460568 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-493c07ad-54fa-4ed2-8255-f8962a7d066d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:56.462136 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-493c07ad-54fa-4ed2-8255-f8962a7d066d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:56.463379 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-493c07ad-54fa-4ed2-8255-f8962a7d066d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1737 microversion: 2.20 time: 0.185751 Jun 07 14:31:56.475244 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 483/930] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:31:56 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:31:57.245758 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-4a7a447a-71d7-4581-a131-9b5cbd69f061 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:57.246491 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-4a7a447a-71d7-4581-a131-9b5cbd69f061 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 25aa543f-396c-46d5-a8b6-2eb21e172198] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:57.265901 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4a7a447a-71d7-4581-a131-9b5cbd69f061 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:57.266593 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4a7a447a-71d7-4581-a131-9b5cbd69f061 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:57.267498 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4a7a447a-71d7-4581-a131-9b5cbd69f061 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:57.270570 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4a7a447a-71d7-4581-a131-9b5cbd69f061 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:57.409808 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-32a057e1-d742-4285-be66-7cc5da569ee5 req-dfd65f3c-5a78-49c7-9f62-f469ea2d3c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25aa543f-396c-46d5-a8b6-2eb21e172198", "name": "network-vif-plugged", "status": "completed", "tag": "2122f609-8a6d-4e5d-bfcb-9d9443103453"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:31:57.432659 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-32a057e1-d742-4285-be66-7cc5da569ee5 req-dfd65f3c-5a78-49c7-9f62-f469ea2d3c6a service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:57.433855 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-32a057e1-d742-4285-be66-7cc5da569ee5 req-dfd65f3c-5a78-49c7-9f62-f469ea2d3c6a service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:57.448922 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-32a057e1-d742-4285-be66-7cc5da569ee5 req-dfd65f3c-5a78-49c7-9f62-f469ea2d3c6a service nova] Creating event network-vif-plugged:2122f609-8a6d-4e5d-bfcb-9d9443103453 for instance 25aa543f-396c-46d5-a8b6-2eb21e172198 on hv-cinder-83608 Jun 07 14:31:57.456113 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-32a057e1-d742-4285-be66-7cc5da569ee5 req-dfd65f3c-5a78-49c7-9f62-f469ea2d3c6a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052197 Jun 07 14:31:57.457470 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 484/931] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:31:57.476264 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-4a7a447a-71d7-4581-a131-9b5cbd69f061 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:57.486669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-4a7a447a-71d7-4581-a131-9b5cbd69f061 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198" status: 200 len: 1266 microversion: 2.1 time: 0.243223 Jun 07 14:31:57.496724 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-aab8664b-8374-4f3e-848a-0184560ebdb8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:57.496724 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-aab8664b-8374-4f3e-848a-0184560ebdb8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:57.498325 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 448/932] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:31:57 2022] GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:31:57.499812 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-aab8664b-8374-4f3e-848a-0184560ebdb8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:57.500838 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-aab8664b-8374-4f3e-848a-0184560ebdb8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:57.501753 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-aab8664b-8374-4f3e-848a-0184560ebdb8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:57.502771 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-aab8664b-8374-4f3e-848a-0184560ebdb8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:57.666110 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-aab8664b-8374-4f3e-848a-0184560ebdb8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:57.674936 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-aab8664b-8374-4f3e-848a-0184560ebdb8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:57.676857 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-aab8664b-8374-4f3e-848a-0184560ebdb8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:57.678345 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-aab8664b-8374-4f3e-848a-0184560ebdb8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1737 microversion: 2.20 time: 0.197804 Jun 07 14:31:57.679282 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 485/933] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:31:57 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:31:58.507382 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-916c4534-bfe8-4ec9-8d1e-fc64ab61c689 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:58.508925 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-916c4534-bfe8-4ec9-8d1e-fc64ab61c689 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 25aa543f-396c-46d5-a8b6-2eb21e172198] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:58.515666 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-916c4534-bfe8-4ec9-8d1e-fc64ab61c689 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:58.516118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-916c4534-bfe8-4ec9-8d1e-fc64ab61c689 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:58.517142 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-916c4534-bfe8-4ec9-8d1e-fc64ab61c689 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:58.517752 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-916c4534-bfe8-4ec9-8d1e-fc64ab61c689 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:58.669615 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-916c4534-bfe8-4ec9-8d1e-fc64ab61c689 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:58.677617 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-916c4534-bfe8-4ec9-8d1e-fc64ab61c689 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198" status: 200 len: 1266 microversion: 2.1 time: 0.177446 Jun 07 14:31:58.686876 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 449/934] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:31:58 2022] GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:31:58.698604 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d7025f5f-c50d-4dec-ad74-bee34ad5699a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:58.699597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-d7025f5f-c50d-4dec-ad74-bee34ad5699a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:58.707236 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d7025f5f-c50d-4dec-ad74-bee34ad5699a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:58.707961 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d7025f5f-c50d-4dec-ad74-bee34ad5699a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:58.709082 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d7025f5f-c50d-4dec-ad74-bee34ad5699a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:58.709669 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d7025f5f-c50d-4dec-ad74-bee34ad5699a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:58.858145 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-d7025f5f-c50d-4dec-ad74-bee34ad5699a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:58.867497 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-d7025f5f-c50d-4dec-ad74-bee34ad5699a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:58.869027 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-d7025f5f-c50d-4dec-ad74-bee34ad5699a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:58.870234 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-d7025f5f-c50d-4dec-ad74-bee34ad5699a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1737 microversion: 2.20 time: 0.175576 Jun 07 14:31:58.872608 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 486/935] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:31:58 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:31:59.694838 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1441cf3e-710d-4678-ac57-d6fcfabc627f tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:59.695609 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1441cf3e-710d-4678-ac57-d6fcfabc627f tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 25aa543f-396c-46d5-a8b6-2eb21e172198] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:59.702029 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1441cf3e-710d-4678-ac57-d6fcfabc627f tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:59.702479 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1441cf3e-710d-4678-ac57-d6fcfabc627f tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:59.703262 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1441cf3e-710d-4678-ac57-d6fcfabc627f tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:59.703702 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1441cf3e-710d-4678-ac57-d6fcfabc627f tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:59.831685 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1441cf3e-710d-4678-ac57-d6fcfabc627f tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:31:59.839850 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1441cf3e-710d-4678-ac57-d6fcfabc627f tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198" status: 200 len: 1453 microversion: 2.1 time: 0.149030 Jun 07 14:31:59.840408 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 450/936] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:31:59 2022] GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:31:59.856305 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-694b6dd7-f79f-4d8d-8b4c-f6bbe9c9fcc7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:59.856926 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-694b6dd7-f79f-4d8d-8b4c-f6bbe9c9fcc7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 25aa543f-396c-46d5-a8b6-2eb21e172198] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:59.863532 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-694b6dd7-f79f-4d8d-8b4c-f6bbe9c9fcc7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:59.864027 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-694b6dd7-f79f-4d8d-8b4c-f6bbe9c9fcc7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:59.864978 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-694b6dd7-f79f-4d8d-8b4c-f6bbe9c9fcc7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:59.865444 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-694b6dd7-f79f-4d8d-8b4c-f6bbe9c9fcc7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:59.889815 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6de2cf28-e55d-48e8-bb74-4f8d0458cf4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:59.890428 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-6de2cf28-e55d-48e8-bb74-4f8d0458cf4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:31:59.897098 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6de2cf28-e55d-48e8-bb74-4f8d0458cf4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:59.897548 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6de2cf28-e55d-48e8-bb74-4f8d0458cf4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:31:59.898320 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6de2cf28-e55d-48e8-bb74-4f8d0458cf4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:31:59.898758 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6de2cf28-e55d-48e8-bb74-4f8d0458cf4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:00.063106 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-694b6dd7-f79f-4d8d-8b4c-f6bbe9c9fcc7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:00.071396 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-694b6dd7-f79f-4d8d-8b4c-f6bbe9c9fcc7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198" status: 200 len: 1453 microversion: 2.1 time: 0.218818 Jun 07 14:32:00.072010 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 487/937] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:31:59 2022] GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198 => generated 1453 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:32:00.075062 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-6de2cf28-e55d-48e8-bb74-4f8d0458cf4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:00.084287 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-6de2cf28-e55d-48e8-bb74-4f8d0458cf4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:00.085429 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-6de2cf28-e55d-48e8-bb74-4f8d0458cf4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:00.086612 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6de2cf28-e55d-48e8-bb74-4f8d0458cf4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1737 microversion: 2.20 time: 0.200622 Jun 07 14:32:00.087174 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 451/938] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:31:59 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1737 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:32:01.106072 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ff9ba482-4624-433a-b4e0-1b47934c4452 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:01.106678 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ff9ba482-4624-433a-b4e0-1b47934c4452 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:01.109162 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:01.114601 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ff9ba482-4624-433a-b4e0-1b47934c4452 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:01.115137 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ff9ba482-4624-433a-b4e0-1b47934c4452 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:01.115928 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ff9ba482-4624-433a-b4e0-1b47934c4452 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:01.116359 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ff9ba482-4624-433a-b4e0-1b47934c4452 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:01.252984 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ff9ba482-4624-433a-b4e0-1b47934c4452 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:01.261439 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ff9ba482-4624-433a-b4e0-1b47934c4452 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:01.262943 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ff9ba482-4624-433a-b4e0-1b47934c4452 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:01.264158 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ff9ba482-4624-433a-b4e0-1b47934c4452 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1719 microversion: 2.20 time: 0.162381 Jun 07 14:32:01.264719 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 488/939] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:32:01 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:02.287467 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-09537217-7790-400e-b61c-82395f850257 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:02.288271 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-09537217-7790-400e-b61c-82395f850257 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:02.290873 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=45 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:02.297960 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-09537217-7790-400e-b61c-82395f850257 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:02.303890 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-c50d4a28-bab6-4010-ba4b-0b578c38126b req-c84608c2-2119-45d8-9a98-c3705ac73700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25aa543f-396c-46d5-a8b6-2eb21e172198", "tag": "2122f609-8a6d-4e5d-bfcb-9d9443103453"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:32:02.304704 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-09537217-7790-400e-b61c-82395f850257 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:02.305669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-09537217-7790-400e-b61c-82395f850257 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:02.306195 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-09537217-7790-400e-b61c-82395f850257 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:02.312864 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-c50d4a28-bab6-4010-ba4b-0b578c38126b req-c84608c2-2119-45d8-9a98-c3705ac73700 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:02.313388 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-c50d4a28-bab6-4010-ba4b-0b578c38126b req-c84608c2-2119-45d8-9a98-c3705ac73700 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:02.324618 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-c50d4a28-bab6-4010-ba4b-0b578c38126b req-c84608c2-2119-45d8-9a98-c3705ac73700 service nova] Creating event network-changed:2122f609-8a6d-4e5d-bfcb-9d9443103453 for instance 25aa543f-396c-46d5-a8b6-2eb21e172198 on hv-cinder-83608 Jun 07 14:32:02.329651 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-c50d4a28-bab6-4010-ba4b-0b578c38126b req-c84608c2-2119-45d8-9a98-c3705ac73700 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030053 Jun 07 14:32:02.330537 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 489/940] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:32:02.437724 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-09537217-7790-400e-b61c-82395f850257 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:02.446564 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-09537217-7790-400e-b61c-82395f850257 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:02.448087 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-09537217-7790-400e-b61c-82395f850257 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:02.449248 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-09537217-7790-400e-b61c-82395f850257 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1719 microversion: 2.20 time: 0.168387 Jun 07 14:32:02.449806 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 452/941] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:32:02 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:03.338742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-a7751ccb-40a7-46bd-a174-9cc25711558d req-5761fe23-7387-4c0a-bd0b-2cdc5e47d7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff2cef5f-a25c-4fa4-b34e-85da9efbdca8", "name": "network-vif-unplugged", "status": "completed", "tag": "6a66cc9b-a903-4e8e-8ab2-720990265484"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:32:03.350467 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-a7751ccb-40a7-46bd-a174-9cc25711558d req-5761fe23-7387-4c0a-bd0b-2cdc5e47d7f5 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:03.351237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-a7751ccb-40a7-46bd-a174-9cc25711558d req-5761fe23-7387-4c0a-bd0b-2cdc5e47d7f5 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:03.364442 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.compute.server_external_events [req-a7751ccb-40a7-46bd-a174-9cc25711558d req-5761fe23-7387-4c0a-bd0b-2cdc5e47d7f5 service nova] Unable to find a host for instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8. Dropping event network-vif-unplugged {{(pid=117565) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 07 14:32:03.365704 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-a7751ccb-40a7-46bd-a174-9cc25711558d req-5761fe23-7387-4c0a-bd0b-2cdc5e47d7f5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032041 Jun 07 14:32:03.366510 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 490/942] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 07 14:32:03.467409 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9d1928bd-b9bb-4417-b54f-299b5438097c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:03.468084 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9d1928bd-b9bb-4417-b54f-299b5438097c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:03.475608 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9d1928bd-b9bb-4417-b54f-299b5438097c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:03.476075 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9d1928bd-b9bb-4417-b54f-299b5438097c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:03.476849 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9d1928bd-b9bb-4417-b54f-299b5438097c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:03.477288 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9d1928bd-b9bb-4417-b54f-299b5438097c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:03.608151 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9d1928bd-b9bb-4417-b54f-299b5438097c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:03.616092 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9d1928bd-b9bb-4417-b54f-299b5438097c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:03.617692 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9d1928bd-b9bb-4417-b54f-299b5438097c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:03.618853 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9d1928bd-b9bb-4417-b54f-299b5438097c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1662 microversion: 2.20 time: 0.155749 Jun 07 14:32:03.619454 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 453/943] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:32:03 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:03.636750 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-91491fe9-8bcb-4bc0-b691-4e2e8dde2566 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bed8f1d3-f032-4922-8138-66a0bc7dfe1b"}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:32:03.637917 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-91491fe9-8bcb-4bc0-b691-4e2e8dde2566 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:03.643966 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-91491fe9-8bcb-4bc0-b691-4e2e8dde2566 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:03.644418 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-91491fe9-8bcb-4bc0-b691-4e2e8dde2566 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:03.645923 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-91491fe9-8bcb-4bc0-b691-4e2e8dde2566 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:03.646372 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-91491fe9-8bcb-4bc0-b691-4e2e8dde2566 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:03.907526 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-91491fe9-8bcb-4bc0-b691-4e2e8dde2566 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "POST /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.274645 Jun 07 14:32:03.908122 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 491/944] 10.222.0.81 () {62 vars in 1363 bytes} [Tue Jun 7 14:32:03 2022] POST /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8/os-volume_attachments => generated 188 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:32:04.022368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a896dfd0-2d92-4f43-8e45-2e293f9d9c55 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:04.022863 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a896dfd0-2d92-4f43-8e45-2e293f9d9c55 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:04.028971 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a896dfd0-2d92-4f43-8e45-2e293f9d9c55 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:04.029416 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a896dfd0-2d92-4f43-8e45-2e293f9d9c55 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:04.030168 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a896dfd0-2d92-4f43-8e45-2e293f9d9c55 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:04.030600 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a896dfd0-2d92-4f43-8e45-2e293f9d9c55 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:04.263207 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a896dfd0-2d92-4f43-8e45-2e293f9d9c55 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8/os-volume_attachments/bed8f1d3-f032-4922-8138-66a0bc7dfe1b" status: 202 len: 0 microversion: 2.20 time: 0.245100 Jun 07 14:32:04.264033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 454/945] 10.222.0.81 () {60 vars in 1456 bytes} [Tue Jun 7 14:32:04 2022] DELETE /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8/os-volume_attachments/bed8f1d3-f032-4922-8138-66a0bc7dfe1b => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:32:04.319135 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-eaa26264-8db0-4792-ac52-d0186f871ccc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:32:04.319656 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-eaa26264-8db0-4792-ac52-d0186f871ccc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:04.326024 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-eaa26264-8db0-4792-ac52-d0186f871ccc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:04.326468 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-eaa26264-8db0-4792-ac52-d0186f871ccc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:04.327239 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-eaa26264-8db0-4792-ac52-d0186f871ccc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:04.327673 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-eaa26264-8db0-4792-ac52-d0186f871ccc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:04.403717 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-eaa26264-8db0-4792-ac52-d0186f871ccc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "POST /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8/action" status: 202 len: 0 microversion: 2.20 time: 0.089133 Jun 07 14:32:04.404410 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 492/946] 10.222.0.81 () {62 vars in 1318 bytes} [Tue Jun 7 14:32:04 2022] POST /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:32:04.413094 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e9c747e6-492b-4ab9-bff6-53aa35a6e106 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:04.413721 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e9c747e6-492b-4ab9-bff6-53aa35a6e106 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:04.420322 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e9c747e6-492b-4ab9-bff6-53aa35a6e106 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:04.420783 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e9c747e6-492b-4ab9-bff6-53aa35a6e106 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:04.421567 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e9c747e6-492b-4ab9-bff6-53aa35a6e106 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:04.422079 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e9c747e6-492b-4ab9-bff6-53aa35a6e106 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:04.558320 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e9c747e6-492b-4ab9-bff6-53aa35a6e106 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:04.566623 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e9c747e6-492b-4ab9-bff6-53aa35a6e106 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:04.568391 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-e9c747e6-492b-4ab9-bff6-53aa35a6e106 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:04.569614 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e9c747e6-492b-4ab9-bff6-53aa35a6e106 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1670 microversion: 2.20 time: 0.161162 Jun 07 14:32:04.570113 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 455/947] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:32:04 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:05.588440 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-b3b63ab0-b4b1-4c19-b3a0-f4a533612207 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:05.589056 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-b3b63ab0-b4b1-4c19-b3a0-f4a533612207 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:05.595453 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b3b63ab0-b4b1-4c19-b3a0-f4a533612207 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:05.595903 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b3b63ab0-b4b1-4c19-b3a0-f4a533612207 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:05.596659 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b3b63ab0-b4b1-4c19-b3a0-f4a533612207 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:05.597098 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b3b63ab0-b4b1-4c19-b3a0-f4a533612207 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:05.731031 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-b3b63ab0-b4b1-4c19-b3a0-f4a533612207 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:05.738841 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-b3b63ab0-b4b1-4c19-b3a0-f4a533612207 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:05.740375 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-b3b63ab0-b4b1-4c19-b3a0-f4a533612207 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:05.741530 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-b3b63ab0-b4b1-4c19-b3a0-f4a533612207 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1728 microversion: 2.20 time: 0.157676 Jun 07 14:32:05.742088 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 493/948] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:32:05 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:06.760440 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-664748ab-db3d-4760-854d-9fdfdb2ee5b8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:06.761660 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-664748ab-db3d-4760-854d-9fdfdb2ee5b8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:06.768837 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-664748ab-db3d-4760-854d-9fdfdb2ee5b8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:06.769600 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-664748ab-db3d-4760-854d-9fdfdb2ee5b8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:06.771348 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-664748ab-db3d-4760-854d-9fdfdb2ee5b8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:06.771974 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-664748ab-db3d-4760-854d-9fdfdb2ee5b8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:06.920626 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-664748ab-db3d-4760-854d-9fdfdb2ee5b8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:06.929851 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-664748ab-db3d-4760-854d-9fdfdb2ee5b8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:06.931563 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-664748ab-db3d-4760-854d-9fdfdb2ee5b8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:06.933348 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-664748ab-db3d-4760-854d-9fdfdb2ee5b8 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1728 microversion: 2.20 time: 0.176641 Jun 07 14:32:06.945214 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 456/949] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:32:06 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1728 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:32:07.954356 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-8f36fcba-038b-497a-b830-afb15810dc4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:07.954908 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-8f36fcba-038b-497a-b830-afb15810dc4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:07.962315 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8f36fcba-038b-497a-b830-afb15810dc4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:07.962773 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8f36fcba-038b-497a-b830-afb15810dc4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:07.963596 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8f36fcba-038b-497a-b830-afb15810dc4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:07.964039 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8f36fcba-038b-497a-b830-afb15810dc4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:08.113412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8f36fcba-038b-497a-b830-afb15810dc4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:08.121597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8f36fcba-038b-497a-b830-afb15810dc4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:08.123109 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-8f36fcba-038b-497a-b830-afb15810dc4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:08.124296 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-8f36fcba-038b-497a-b830-afb15810dc4b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1728 microversion: 2.20 time: 0.173934 Jun 07 14:32:08.124857 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 494/950] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:32:07 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:09.144977 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3cbdccb4-427f-4c4f-bce6-4558e5013ba2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:09.146636 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3cbdccb4-427f-4c4f-bce6-4558e5013ba2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:09.154681 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3cbdccb4-427f-4c4f-bce6-4558e5013ba2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:09.155517 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3cbdccb4-427f-4c4f-bce6-4558e5013ba2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:09.156537 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3cbdccb4-427f-4c4f-bce6-4558e5013ba2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:09.157276 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3cbdccb4-427f-4c4f-bce6-4558e5013ba2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:09.300636 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3cbdccb4-427f-4c4f-bce6-4558e5013ba2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:09.311978 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3cbdccb4-427f-4c4f-bce6-4558e5013ba2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:09.313587 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-3cbdccb4-427f-4c4f-bce6-4558e5013ba2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:09.314849 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3cbdccb4-427f-4c4f-bce6-4558e5013ba2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1728 microversion: 2.20 time: 0.175090 Jun 07 14:32:09.315775 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 457/951] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:32:09 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:10.336126 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-c404fc49-08a3-4a97-a2b4-d492452c85e3 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:10.336996 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-c404fc49-08a3-4a97-a2b4-d492452c85e3 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:10.344095 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c404fc49-08a3-4a97-a2b4-d492452c85e3 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:10.344810 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c404fc49-08a3-4a97-a2b4-d492452c85e3 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:10.346086 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c404fc49-08a3-4a97-a2b4-d492452c85e3 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:10.346721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c404fc49-08a3-4a97-a2b4-d492452c85e3 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:10.488639 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-c404fc49-08a3-4a97-a2b4-d492452c85e3 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:10.498064 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-c404fc49-08a3-4a97-a2b4-d492452c85e3 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:10.500309 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-c404fc49-08a3-4a97-a2b4-d492452c85e3 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:10.501646 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-c404fc49-08a3-4a97-a2b4-d492452c85e3 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1728 microversion: 2.20 time: 0.171458 Jun 07 14:32:10.514536 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 495/952] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:32:10 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1728 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:11.521113 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-977820e9-4529-487e-926a-260c35f65bef tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:11.521741 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-977820e9-4529-487e-926a-260c35f65bef tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:11.528940 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-977820e9-4529-487e-926a-260c35f65bef tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:11.529331 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-977820e9-4529-487e-926a-260c35f65bef tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:11.530134 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-977820e9-4529-487e-926a-260c35f65bef tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:11.530550 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-977820e9-4529-487e-926a-260c35f65bef tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:11.685603 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-977820e9-4529-487e-926a-260c35f65bef tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:11.694287 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-977820e9-4529-487e-926a-260c35f65bef tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:11.695842 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-977820e9-4529-487e-926a-260c35f65bef tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:11.697052 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-977820e9-4529-487e-926a-260c35f65bef tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1728 microversion: 2.20 time: 0.180006 Jun 07 14:32:11.697616 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 458/953] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:32:11 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:12.715826 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-60fe9010-b34e-4f07-a8c1-b54f6f7c22f0 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:12.716475 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-60fe9010-b34e-4f07-a8c1-b54f6f7c22f0 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:12.723437 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-60fe9010-b34e-4f07-a8c1-b54f6f7c22f0 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:12.723891 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-60fe9010-b34e-4f07-a8c1-b54f6f7c22f0 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:12.724756 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-60fe9010-b34e-4f07-a8c1-b54f6f7c22f0 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:12.725357 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-60fe9010-b34e-4f07-a8c1-b54f6f7c22f0 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:12.871910 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-60fe9010-b34e-4f07-a8c1-b54f6f7c22f0 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:12.886704 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-60fe9010-b34e-4f07-a8c1-b54f6f7c22f0 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:12.888275 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-60fe9010-b34e-4f07-a8c1-b54f6f7c22f0 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:12.889455 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-60fe9010-b34e-4f07-a8c1-b54f6f7c22f0 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1728 microversion: 2.20 time: 0.177582 Jun 07 14:32:12.890009 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 496/954] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:32:12 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:13.910670 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a95e47b5-efe2-4012-ac4d-6e81b3a0fb71 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:13.911957 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a95e47b5-efe2-4012-ac4d-6e81b3a0fb71 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:13.919085 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a95e47b5-efe2-4012-ac4d-6e81b3a0fb71 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:13.919856 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a95e47b5-efe2-4012-ac4d-6e81b3a0fb71 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:13.920636 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a95e47b5-efe2-4012-ac4d-6e81b3a0fb71 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:13.921085 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a95e47b5-efe2-4012-ac4d-6e81b3a0fb71 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:14.087465 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a95e47b5-efe2-4012-ac4d-6e81b3a0fb71 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:14.096250 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a95e47b5-efe2-4012-ac4d-6e81b3a0fb71 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:14.097778 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a95e47b5-efe2-4012-ac4d-6e81b3a0fb71 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:14.098964 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a95e47b5-efe2-4012-ac4d-6e81b3a0fb71 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1728 microversion: 2.20 time: 0.194022 Jun 07 14:32:14.103604 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 459/955] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:32:13 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1728 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:15.117412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-259ddbb6-62f6-497d-b3ca-ff7d840c2760 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:15.118023 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-259ddbb6-62f6-497d-b3ca-ff7d840c2760 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:15.124916 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-259ddbb6-62f6-497d-b3ca-ff7d840c2760 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:15.125373 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-259ddbb6-62f6-497d-b3ca-ff7d840c2760 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:15.126159 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-259ddbb6-62f6-497d-b3ca-ff7d840c2760 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:15.126598 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-259ddbb6-62f6-497d-b3ca-ff7d840c2760 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:15.257167 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-259ddbb6-62f6-497d-b3ca-ff7d840c2760 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:15.260694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:15.265961 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-259ddbb6-62f6-497d-b3ca-ff7d840c2760 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:15.267511 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-259ddbb6-62f6-497d-b3ca-ff7d840c2760 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:15.268678 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-259ddbb6-62f6-497d-b3ca-ff7d840c2760 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1728 microversion: 2.20 time: 0.155859 Jun 07 14:32:15.269239 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 497/956] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:32:15 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:16.286495 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-620204ec-f467-4a75-b0d1-8526825347fa tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:16.287718 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-620204ec-f467-4a75-b0d1-8526825347fa tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:16.294474 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-620204ec-f467-4a75-b0d1-8526825347fa tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:16.294921 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-620204ec-f467-4a75-b0d1-8526825347fa tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:16.295719 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-620204ec-f467-4a75-b0d1-8526825347fa tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:16.296156 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-620204ec-f467-4a75-b0d1-8526825347fa tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:16.436279 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-620204ec-f467-4a75-b0d1-8526825347fa tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:16.438497 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:16.446201 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-620204ec-f467-4a75-b0d1-8526825347fa tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:16.447736 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-620204ec-f467-4a75-b0d1-8526825347fa tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:16.448942 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-620204ec-f467-4a75-b0d1-8526825347fa tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1728 microversion: 2.20 time: 0.166565 Jun 07 14:32:16.449534 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 460/957] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:32:16 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:17.468452 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-10319af7-f830-4cbf-a11a-9d3d926b8b84 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:17.469079 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-10319af7-f830-4cbf-a11a-9d3d926b8b84 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:17.478395 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-10319af7-f830-4cbf-a11a-9d3d926b8b84 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:17.478835 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-10319af7-f830-4cbf-a11a-9d3d926b8b84 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:17.479641 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-10319af7-f830-4cbf-a11a-9d3d926b8b84 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:17.480082 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-10319af7-f830-4cbf-a11a-9d3d926b8b84 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:17.615973 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-10319af7-f830-4cbf-a11a-9d3d926b8b84 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:17.624009 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-10319af7-f830-4cbf-a11a-9d3d926b8b84 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:17.625512 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-10319af7-f830-4cbf-a11a-9d3d926b8b84 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:17.626665 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-10319af7-f830-4cbf-a11a-9d3d926b8b84 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1728 microversion: 2.20 time: 0.163126 Jun 07 14:32:17.627249 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 498/958] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:32:17 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:18.644737 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-4dfc495f-7ffa-4ed4-8cd1-20da3e2f481d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:18.645388 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-4dfc495f-7ffa-4ed4-8cd1-20da3e2f481d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:18.653154 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4dfc495f-7ffa-4ed4-8cd1-20da3e2f481d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:18.653612 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4dfc495f-7ffa-4ed4-8cd1-20da3e2f481d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:18.654579 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4dfc495f-7ffa-4ed4-8cd1-20da3e2f481d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:18.654816 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4dfc495f-7ffa-4ed4-8cd1-20da3e2f481d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:18.782364 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-4dfc495f-7ffa-4ed4-8cd1-20da3e2f481d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:18.790519 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-4dfc495f-7ffa-4ed4-8cd1-20da3e2f481d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:18.792075 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-4dfc495f-7ffa-4ed4-8cd1-20da3e2f481d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:18.793237 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-4dfc495f-7ffa-4ed4-8cd1-20da3e2f481d tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1728 microversion: 2.20 time: 0.152549 Jun 07 14:32:18.793812 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 461/959] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:32:18 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:19.663798 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-5e0214bf-82e6-4371-a034-8ea27533b444 req-38343103-9882-44e2-8a72-3b410589515d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff2cef5f-a25c-4fa4-b34e-85da9efbdca8", "name": "network-vif-plugged", "status": "completed", "tag": "6a66cc9b-a903-4e8e-8ab2-720990265484"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:32:19.672601 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-5e0214bf-82e6-4371-a034-8ea27533b444 req-38343103-9882-44e2-8a72-3b410589515d service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:19.672601 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-5e0214bf-82e6-4371-a034-8ea27533b444 req-38343103-9882-44e2-8a72-3b410589515d service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:19.683888 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-5e0214bf-82e6-4371-a034-8ea27533b444 req-38343103-9882-44e2-8a72-3b410589515d service nova] Creating event network-vif-plugged:6a66cc9b-a903-4e8e-8ab2-720990265484 for instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 on hv-cinder-83608 Jun 07 14:32:19.688876 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-5e0214bf-82e6-4371-a034-8ea27533b444 req-38343103-9882-44e2-8a72-3b410589515d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085285 Jun 07 14:32:19.689464 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 499/960] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:32:19.811251 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-252fa68e-192a-4edf-b77f-2e6d3b78410a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:19.811939 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-252fa68e-192a-4edf-b77f-2e6d3b78410a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:19.818428 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-252fa68e-192a-4edf-b77f-2e6d3b78410a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:19.818934 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-252fa68e-192a-4edf-b77f-2e6d3b78410a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:19.819759 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-252fa68e-192a-4edf-b77f-2e6d3b78410a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:19.820203 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-252fa68e-192a-4edf-b77f-2e6d3b78410a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:19.957663 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-252fa68e-192a-4edf-b77f-2e6d3b78410a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:19.965656 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-252fa68e-192a-4edf-b77f-2e6d3b78410a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:19.967167 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-252fa68e-192a-4edf-b77f-2e6d3b78410a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:19.968381 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-252fa68e-192a-4edf-b77f-2e6d3b78410a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1728 microversion: 2.20 time: 0.161087 Jun 07 14:32:19.968947 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 462/961] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:32:19 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:20.988321 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-67268d2c-1f4e-4b59-b560-5e809c788fbc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:20.989054 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-67268d2c-1f4e-4b59-b560-5e809c788fbc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:20.995373 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-67268d2c-1f4e-4b59-b560-5e809c788fbc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:20.995826 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-67268d2c-1f4e-4b59-b560-5e809c788fbc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:20.996590 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-67268d2c-1f4e-4b59-b560-5e809c788fbc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:20.997033 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-67268d2c-1f4e-4b59-b560-5e809c788fbc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:21.133965 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-67268d2c-1f4e-4b59-b560-5e809c788fbc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:21.141921 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-67268d2c-1f4e-4b59-b560-5e809c788fbc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:21.143442 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-67268d2c-1f4e-4b59-b560-5e809c788fbc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:21.144755 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-67268d2c-1f4e-4b59-b560-5e809c788fbc tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1728 microversion: 2.20 time: 0.161108 Jun 07 14:32:21.145128 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 500/962] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:32:20 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:22.164116 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-eb1a4868-0830-478e-99ae-35a214a26de4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:22.164722 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-eb1a4868-0830-478e-99ae-35a214a26de4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:22.171318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eb1a4868-0830-478e-99ae-35a214a26de4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:22.171776 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eb1a4868-0830-478e-99ae-35a214a26de4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:22.172547 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eb1a4868-0830-478e-99ae-35a214a26de4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:22.172981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-eb1a4868-0830-478e-99ae-35a214a26de4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:22.303371 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-eb1a4868-0830-478e-99ae-35a214a26de4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:22.311207 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-eb1a4868-0830-478e-99ae-35a214a26de4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:22.312751 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-eb1a4868-0830-478e-99ae-35a214a26de4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:22.313896 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-eb1a4868-0830-478e-99ae-35a214a26de4 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1715 microversion: 2.20 time: 0.154140 Jun 07 14:32:22.314455 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 463/963] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:32:22 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1715 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:55.066124 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-8059c266-2846-40ca-97a5-b2d796939f5b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:55.067057 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-8059c266-2846-40ca-97a5-b2d796939f5b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:55.069394 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=27 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:55.070056 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=14 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:55.075969 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8059c266-2846-40ca-97a5-b2d796939f5b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:55.076428 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8059c266-2846-40ca-97a5-b2d796939f5b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:55.077198 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8059c266-2846-40ca-97a5-b2d796939f5b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:55.077638 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-8059c266-2846-40ca-97a5-b2d796939f5b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:55.106337 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-8059c266-2846-40ca-97a5-b2d796939f5b tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044127 Jun 07 14:32:55.106887 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 501/964] 10.222.0.81 () {60 vars in 1342 bytes} [Tue Jun 7 14:32:55 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:32:55.162868 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f5e7ec41-7145-4ae7-ae4b-f75a07c5ad45 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:55.163428 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f5e7ec41-7145-4ae7-ae4b-f75a07c5ad45 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:55.166137 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=23 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:55.166969 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=19 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:55.173325 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f5e7ec41-7145-4ae7-ae4b-f75a07c5ad45 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:55.173784 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f5e7ec41-7145-4ae7-ae4b-f75a07c5ad45 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:55.174572 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f5e7ec41-7145-4ae7-ae4b-f75a07c5ad45 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:55.175014 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f5e7ec41-7145-4ae7-ae4b-f75a07c5ad45 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:55.200178 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f5e7ec41-7145-4ae7-ae4b-f75a07c5ad45 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Going to try to terminate instance {{(pid=117564) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:32:55.277423 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f5e7ec41-7145-4ae7-ae4b-f75a07c5ad45 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 204 len: 0 microversion: 2.20 time: 0.117854 Jun 07 14:32:55.278068 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 464/965] 10.222.0.81 () {60 vars in 1279 bytes} [Tue Jun 7 14:32:55 2022] DELETE /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 14:32:55.286867 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-49eedf35-6fd4-4e8e-8ba2-1a7782c4d936 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:55.287660 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-49eedf35-6fd4-4e8e-8ba2-1a7782c4d936 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:55.294851 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-49eedf35-6fd4-4e8e-8ba2-1a7782c4d936 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:55.295392 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-49eedf35-6fd4-4e8e-8ba2-1a7782c4d936 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:55.296168 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-49eedf35-6fd4-4e8e-8ba2-1a7782c4d936 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:55.296603 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-49eedf35-6fd4-4e8e-8ba2-1a7782c4d936 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:55.427485 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-49eedf35-6fd4-4e8e-8ba2-1a7782c4d936 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:55.435368 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-49eedf35-6fd4-4e8e-8ba2-1a7782c4d936 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:55.436876 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-49eedf35-6fd4-4e8e-8ba2-1a7782c4d936 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:55.438032 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-49eedf35-6fd4-4e8e-8ba2-1a7782c4d936 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1721 microversion: 2.20 time: 0.155751 Jun 07 14:32:55.438591 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 502/966] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:32:55 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:56.456687 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1015da4a-1033-4796-85bd-967759352552 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:56.457315 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1015da4a-1033-4796-85bd-967759352552 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:56.463972 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1015da4a-1033-4796-85bd-967759352552 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:56.464423 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1015da4a-1033-4796-85bd-967759352552 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:56.465192 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1015da4a-1033-4796-85bd-967759352552 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:56.465631 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1015da4a-1033-4796-85bd-967759352552 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:56.597249 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1015da4a-1033-4796-85bd-967759352552 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:56.605683 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1015da4a-1033-4796-85bd-967759352552 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:56.607171 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1015da4a-1033-4796-85bd-967759352552 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:56.608344 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1015da4a-1033-4796-85bd-967759352552 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1721 microversion: 2.20 time: 0.156053 Jun 07 14:32:56.608901 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 465/967] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:32:56 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:57.626653 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d867414a-8c13-4268-b09c-1e0109252b59 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:57.627354 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-d867414a-8c13-4268-b09c-1e0109252b59 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:57.637348 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d867414a-8c13-4268-b09c-1e0109252b59 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:57.637928 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d867414a-8c13-4268-b09c-1e0109252b59 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:57.638827 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d867414a-8c13-4268-b09c-1e0109252b59 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:57.639408 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d867414a-8c13-4268-b09c-1e0109252b59 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:57.674794 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-7465a472-0717-449a-a601-494c03689ded req-dd1cad20-a1da-4a43-a765-cdd498d009b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff2cef5f-a25c-4fa4-b34e-85da9efbdca8", "name": "network-vif-deleted", "tag": "6a66cc9b-a903-4e8e-8ab2-720990265484"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:32:57.684129 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-7465a472-0717-449a-a601-494c03689ded req-dd1cad20-a1da-4a43-a765-cdd498d009b2 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:57.684581 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-7465a472-0717-449a-a601-494c03689ded req-dd1cad20-a1da-4a43-a765-cdd498d009b2 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:57.696425 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-7465a472-0717-449a-a601-494c03689ded req-dd1cad20-a1da-4a43-a765-cdd498d009b2 service nova] Creating event network-vif-deleted:6a66cc9b-a903-4e8e-8ab2-720990265484 for instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 on hv-cinder-83608 Jun 07 14:32:57.702571 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-7465a472-0717-449a-a601-494c03689ded req-dd1cad20-a1da-4a43-a765-cdd498d009b2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031491 Jun 07 14:32:57.703275 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 466/968] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:32:57.731196 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-d867414a-8c13-4268-b09c-1e0109252b59 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:57.740642 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-d867414a-8c13-4268-b09c-1e0109252b59 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:57.742472 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-d867414a-8c13-4268-b09c-1e0109252b59 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fefdd9dfa11641a598fcc29b2ad32afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a6f6bdf7743cba1a36a3e8f67cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:32:57.744420 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-d867414a-8c13-4268-b09c-1e0109252b59 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 200 len: 1654 microversion: 2.20 time: 0.120934 Jun 07 14:32:57.755154 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 503/969] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:32:57 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 1654 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:58.763517 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-664702f7-c149-47fc-8310-266e5c4c111a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:58.764215 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-664702f7-c149-47fc-8310-266e5c4c111a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:32:58.770501 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-664702f7-c149-47fc-8310-266e5c4c111a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:58.770951 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-664702f7-c149-47fc-8310-266e5c4c111a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:58.771756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-664702f7-c149-47fc-8310-266e5c4c111a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:32:58.772195 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-664702f7-c149-47fc-8310-266e5c4c111a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:32:58.785380 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-664702f7-c149-47fc-8310-266e5c4c111a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] HTTP exception thrown: Instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 could not be found. Jun 07 14:32:58.786981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-664702f7-c149-47fc-8310-266e5c4c111a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Request method failure captured: Jun 07 14:32:58.786981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 HTTP/1.1 Jun 07 14:32:58.786981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 07 14:32:58.786981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 07 14:32:58.786981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Connection: close Jun 07 14:32:58.786981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 07 14:32:58.786981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 07 14:32:58.786981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Host: 10.222.0.81 Jun 07 14:32:58.786981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 07 14:32:58.786981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 07 14:32:58.786981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABin2BvHw8qXohK6PwC1vEO7h5uuxZx_wOlISE40LeCzFaeGL69IFlImRQozIdjEBYOVrcVx2Zukqf3gYQtOz-oJaTLAqRfMx2wyPMTldZdiNF3yXFFqeoae4rO4M0pcxN31QXSFx33PHHi7fCBMk1qC9bjav0PveuTcxx9sWYL66eQMd8 Jun 07 14:32:58.786981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 07 14:32:58.786981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 07 14:32:58.786981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 07 14:32:58.786981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 07 14:32:58.786981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 14:32:58.786981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 07 14:32:58.786981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 07 14:32:58.786981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Id: 4c6a6f6bdf7743cba1a36a3e8f67cf02 Jun 07 14:32:58.786981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1238086752 Jun 07 14:32:58.786981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Role: member,reader Jun 07 14:32:58.786981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Roles: member,reader Jun 07 14:32:58.788556 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4c6a6f6bdf7743cba1a36a3e8f67cf02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4c6a6f6bdf7743cba1a36a3e8f67cf02", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4c6a6f6bdf7743cba1a36a3e8f67cf02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4c6a6f6bdf7743cba1a36a3e8f67cf02"}]}] Jun 07 14:32:58.788556 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1238086752 Jun 07 14:32:58.788556 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 4c6a6f6bdf7743cba1a36a3e8f67cf02 Jun 07 14:32:58.788556 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1238086752 Jun 07 14:32:58.788556 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User: tempest-AttachVolumeShelveTestJSON-1238086752-project Jun 07 14:32:58.788556 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 07 14:32:58.788556 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 07 14:32:58.788556 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Id: fefdd9dfa11641a598fcc29b2ad32afc Jun 07 14:32:58.788556 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1238086752-project Jun 07 14:32:58.788556 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: method: > Jun 07 14:32:58.788556 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: exception: Instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 could not be found. Jun 07 14:32:58.788556 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: action_args: {'id': 'ff2cef5f-a25c-4fa4-b34e-85da9efbdca8'} Jun 07 14:32:58.789355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:32:58.789355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:32:58.789355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:32:58.789355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:32:58.789355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:32:58.789355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:32:58.789355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:32:58.789355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:32:58.789355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:32:58.789355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:32:58.789355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 could not be found. Jun 07 14:32:58.789355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:32:58.789355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:32:58.789355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:32:58.789355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:32:58.789355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:32:58.789355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:32:58.789355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:32:58.789355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:32:58.789355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:32:58.791780 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:32:58.791780 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:32:58.791780 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:32:58.791780 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:32:58.791780 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:32:58.791780 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:32:58.791780 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:32:58.791780 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 could not be found. Jun 07 14:32:58.791780 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:32:58.791780 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:32:58.791780 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:32:58.791780 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:32:58.791780 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:32:58.791780 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:32:58.791780 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:32:58.791780 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:32:58.791780 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 could not be found. Jun 07 14:32:58.791780 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:32:58.793195 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-664702f7-c149-47fc-8310-266e5c4c111a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Returning 404 to user: Instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:32:58.793195 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-664702f7-c149-47fc-8310-266e5c4c111a tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 404 len: 111 microversion: 2.20 time: 0.029924 Jun 07 14:32:58.793195 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 467/970] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:32:58 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 14:32:58.797938 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ad1d85c1-881d-406a-a693-978427ebaff3 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '.version_select at 0x7ff37f780a60>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:58.817052 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ad1d85c1-881d-406a-a693-978427ebaff3 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-82765413" status: 204 len: 0 microversion: 2.20 time: 0.022963 Jun 07 14:32:58.817609 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 504/971] 10.222.0.81 () {60 vars in 1255 bytes} [Tue Jun 7 14:32:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-82765413 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 07 14:33:00.852737 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d869d4cd-f2ae-482b-8e2c-29ca82e23b11 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:00.853855 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-d869d4cd-f2ae-482b-8e2c-29ca82e23b11 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:00.860323 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d869d4cd-f2ae-482b-8e2c-29ca82e23b11 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:00.860772 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d869d4cd-f2ae-482b-8e2c-29ca82e23b11 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:00.861533 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d869d4cd-f2ae-482b-8e2c-29ca82e23b11 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:00.861974 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-d869d4cd-f2ae-482b-8e2c-29ca82e23b11 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:00.875278 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-d869d4cd-f2ae-482b-8e2c-29ca82e23b11 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] HTTP exception thrown: Instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 could not be found. Jun 07 14:33:00.876848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d869d4cd-f2ae-482b-8e2c-29ca82e23b11 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Request method failure captured: Jun 07 14:33:00.876848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: request: DELETE /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 HTTP/1.1 Jun 07 14:33:00.876848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 07 14:33:00.876848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 07 14:33:00.876848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Connection: close Jun 07 14:33:00.876848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 07 14:33:00.876848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 07 14:33:00.876848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Host: 10.222.0.81 Jun 07 14:33:00.876848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 07 14:33:00.876848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 07 14:33:00.876848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABin2BvHw8qXohK6PwC1vEO7h5uuxZx_wOlISE40LeCzFaeGL69IFlImRQozIdjEBYOVrcVx2Zukqf3gYQtOz-oJaTLAqRfMx2wyPMTldZdiNF3yXFFqeoae4rO4M0pcxN31QXSFx33PHHi7fCBMk1qC9bjav0PveuTcxx9sWYL66eQMd8 Jun 07 14:33:00.876848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 07 14:33:00.876848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 07 14:33:00.876848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 07 14:33:00.876848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 07 14:33:00.876848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 14:33:00.876848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 07 14:33:00.876848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 07 14:33:00.876848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Id: 4c6a6f6bdf7743cba1a36a3e8f67cf02 Jun 07 14:33:00.876848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1238086752 Jun 07 14:33:00.876848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Role: member,reader Jun 07 14:33:00.876848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Roles: member,reader Jun 07 14:33:00.878546 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4c6a6f6bdf7743cba1a36a3e8f67cf02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4c6a6f6bdf7743cba1a36a3e8f67cf02", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4c6a6f6bdf7743cba1a36a3e8f67cf02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4c6a6f6bdf7743cba1a36a3e8f67cf02"}]}] Jun 07 14:33:00.878546 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1238086752 Jun 07 14:33:00.878546 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 4c6a6f6bdf7743cba1a36a3e8f67cf02 Jun 07 14:33:00.878546 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1238086752 Jun 07 14:33:00.878546 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User: tempest-AttachVolumeShelveTestJSON-1238086752-project Jun 07 14:33:00.878546 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 07 14:33:00.878546 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 07 14:33:00.878546 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Id: fefdd9dfa11641a598fcc29b2ad32afc Jun 07 14:33:00.878546 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1238086752-project Jun 07 14:33:00.878546 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: method: > Jun 07 14:33:00.878546 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: exception: Instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 could not be found. Jun 07 14:33:00.878546 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: action_args: {'id': 'ff2cef5f-a25c-4fa4-b34e-85da9efbdca8'} Jun 07 14:33:00.879508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:33:00.879508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:33:00.879508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:33:00.879508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:33:00.879508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:33:00.879508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:33:00.879508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:33:00.879508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:33:00.879508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:33:00.879508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:33:00.879508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 could not be found. Jun 07 14:33:00.879508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:33:00.879508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:33:00.879508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:33:00.879508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:33:00.879508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:33:00.879508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:33:00.879508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:33:00.879508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:33:00.879508 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:33:00.881018 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:33:00.881018 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 14:33:00.881018 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 14:33:00.881018 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 14:33:00.881018 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 14:33:00.881018 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:33:00.881018 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:33:00.881018 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:33:00.881018 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:33:00.881018 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 could not be found. Jun 07 14:33:00.881018 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:33:00.881018 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:33:00.881018 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:33:00.881018 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:33:00.881018 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:33:00.881018 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:33:00.881018 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:33:00.881018 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:33:00.881018 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 could not be found. Jun 07 14:33:00.881018 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:33:00.882590 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d869d4cd-f2ae-482b-8e2c-29ca82e23b11 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Returning 404 to user: Instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:33:00.882590 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d869d4cd-f2ae-482b-8e2c-29ca82e23b11 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 404 len: 111 microversion: 2.20 time: 0.029340 Jun 07 14:33:00.882590 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 468/972] 10.222.0.81 () {60 vars in 1279 bytes} [Tue Jun 7 14:33:00 2022] DELETE /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 14:33:00.888622 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3706df72-c16e-4557-ab48-0df9042fb16c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:00.889242 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-3706df72-c16e-4557-ab48-0df9042fb16c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: ff2cef5f-a25c-4fa4-b34e-85da9efbdca8] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:00.896291 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3706df72-c16e-4557-ab48-0df9042fb16c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:00.896744 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3706df72-c16e-4557-ab48-0df9042fb16c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:00.897502 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3706df72-c16e-4557-ab48-0df9042fb16c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:00.897940 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3706df72-c16e-4557-ab48-0df9042fb16c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:00.911390 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-3706df72-c16e-4557-ab48-0df9042fb16c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] HTTP exception thrown: Instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 could not be found. Jun 07 14:33:00.913038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3706df72-c16e-4557-ab48-0df9042fb16c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Request method failure captured: Jun 07 14:33:00.913038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 HTTP/1.1 Jun 07 14:33:00.913038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:33:00.913038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:33:00.913038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:33:00.913038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:33:00.913038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:33:00.913038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:33:00.913038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:33:00.913038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:33:00.913038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin2BvHw8qXohK6PwC1vEO7h5uuxZx_wOlISE40LeCzFaeGL69IFlImRQozIdjEBYOVrcVx2Zukqf3gYQtOz-oJaTLAqRfMx2wyPMTldZdiNF3yXFFqeoae4rO4M0pcxN31QXSFx33PHHi7fCBMk1qC9bjav0PveuTcxx9sWYL66eQMd8 Jun 07 14:33:00.913038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:33:00.913038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:33:00.913038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:33:00.913038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:33:00.913038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 14:33:00.913038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:33:00.913038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:33:00.913038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: 4c6a6f6bdf7743cba1a36a3e8f67cf02 Jun 07 14:33:00.913038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1238086752 Jun 07 14:33:00.913038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:33:00.913038 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:33:00.914684 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4c6a6f6bdf7743cba1a36a3e8f67cf02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4c6a6f6bdf7743cba1a36a3e8f67cf02", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4c6a6f6bdf7743cba1a36a3e8f67cf02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4c6a6f6bdf7743cba1a36a3e8f67cf02"}]}] Jun 07 14:33:00.914684 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1238086752 Jun 07 14:33:00.914684 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: 4c6a6f6bdf7743cba1a36a3e8f67cf02 Jun 07 14:33:00.914684 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1238086752 Jun 07 14:33:00.914684 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-AttachVolumeShelveTestJSON-1238086752-project Jun 07 14:33:00.914684 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:33:00.914684 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:33:00.914684 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: fefdd9dfa11641a598fcc29b2ad32afc Jun 07 14:33:00.914684 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1238086752-project Jun 07 14:33:00.914684 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:33:00.914684 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 could not be found. Jun 07 14:33:00.914684 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': 'ff2cef5f-a25c-4fa4-b34e-85da9efbdca8'} Jun 07 14:33:00.916194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:33:00.916194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:33:00.916194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:33:00.916194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:33:00.916194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:33:00.916194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:33:00.916194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:33:00.916194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:33:00.916194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:33:00.916194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:33:00.916194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 could not be found. Jun 07 14:33:00.916194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:00.916194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:33:00.916194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:00.916194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:33:00.916194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:33:00.916194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:33:00.916194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:33:00.916194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:33:00.916194 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:33:00.917721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:33:00.917721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:33:00.917721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:33:00.917721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:33:00.917721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:33:00.917721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:33:00.917721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:33:00.917721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 could not be found. Jun 07 14:33:00.917721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:00.917721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:33:00.917721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:00.917721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:33:00.917721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:33:00.917721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:33:00.917721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:33:00.917721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:33:00.917721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 could not be found. Jun 07 14:33:00.917721 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:00.919322 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3706df72-c16e-4557-ab48-0df9042fb16c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Returning 404 to user: Instance ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:33:00.919322 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-3706df72-c16e-4557-ab48-0df9042fb16c tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8" status: 404 len: 111 microversion: 2.20 time: 0.031552 Jun 07 14:33:00.919322 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 505/973] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:33:00 2022] GET /compute/v2.1/servers/ff2cef5f-a25c-4fa4-b34e-85da9efbdca8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 07 14:33:02.048766 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7e665af6-276a-4b2f-9a56-5598216651a2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:02.049270 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7e665af6-276a-4b2f-9a56-5598216651a2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:02.055746 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7e665af6-276a-4b2f-9a56-5598216651a2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:02.056307 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7e665af6-276a-4b2f-9a56-5598216651a2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:02.057305 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7e665af6-276a-4b2f-9a56-5598216651a2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:02.057746 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7e665af6-276a-4b2f-9a56-5598216651a2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:02.070901 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-7e665af6-276a-4b2f-9a56-5598216651a2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] HTTP exception thrown: Instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718 could not be found. Jun 07 14:33:02.072705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7e665af6-276a-4b2f-9a56-5598216651a2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Request method failure captured: Jun 07 14:33:02.072705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: request: DELETE /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 HTTP/1.1 Jun 07 14:33:02.072705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 07 14:33:02.072705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 07 14:33:02.072705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Connection: close Jun 07 14:33:02.072705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 07 14:33:02.072705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 07 14:33:02.072705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Host: 10.222.0.81 Jun 07 14:33:02.072705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 07 14:33:02.072705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 07 14:33:02.072705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABin2BvHw8qXohK6PwC1vEO7h5uuxZx_wOlISE40LeCzFaeGL69IFlImRQozIdjEBYOVrcVx2Zukqf3gYQtOz-oJaTLAqRfMx2wyPMTldZdiNF3yXFFqeoae4rO4M0pcxN31QXSFx33PHHi7fCBMk1qC9bjav0PveuTcxx9sWYL66eQMd8 Jun 07 14:33:02.072705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 07 14:33:02.072705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 07 14:33:02.072705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 07 14:33:02.072705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 07 14:33:02.072705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 14:33:02.072705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 07 14:33:02.072705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 07 14:33:02.072705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Id: 4c6a6f6bdf7743cba1a36a3e8f67cf02 Jun 07 14:33:02.072705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1238086752 Jun 07 14:33:02.072705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Role: member,reader Jun 07 14:33:02.072705 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Roles: member,reader Jun 07 14:33:02.074360 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4c6a6f6bdf7743cba1a36a3e8f67cf02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4c6a6f6bdf7743cba1a36a3e8f67cf02", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4c6a6f6bdf7743cba1a36a3e8f67cf02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4c6a6f6bdf7743cba1a36a3e8f67cf02"}]}] Jun 07 14:33:02.074360 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1238086752 Jun 07 14:33:02.074360 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 4c6a6f6bdf7743cba1a36a3e8f67cf02 Jun 07 14:33:02.074360 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1238086752 Jun 07 14:33:02.074360 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User: tempest-AttachVolumeShelveTestJSON-1238086752-project Jun 07 14:33:02.074360 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 07 14:33:02.074360 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 07 14:33:02.074360 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Id: fefdd9dfa11641a598fcc29b2ad32afc Jun 07 14:33:02.074360 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1238086752-project Jun 07 14:33:02.074360 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: method: > Jun 07 14:33:02.074360 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: exception: Instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718 could not be found. Jun 07 14:33:02.074360 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: action_args: {'id': 'a2ed6c33-30a8-4a3b-aba5-57610c2ec718'} Jun 07 14:33:02.075253 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:33:02.075253 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:33:02.075253 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:33:02.075253 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:33:02.075253 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:33:02.075253 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:33:02.075253 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:33:02.075253 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:33:02.075253 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:33:02.075253 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:33:02.075253 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718 could not be found. Jun 07 14:33:02.075253 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:33:02.075253 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:33:02.075253 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:33:02.075253 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:33:02.075253 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:33:02.075253 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:33:02.075253 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:33:02.075253 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:33:02.075253 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:33:02.076756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:33:02.076756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 14:33:02.076756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 14:33:02.076756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 14:33:02.076756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 14:33:02.076756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:33:02.076756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:33:02.076756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:33:02.076756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:33:02.076756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718 could not be found. Jun 07 14:33:02.076756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:33:02.076756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:33:02.076756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:33:02.076756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:33:02.076756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:33:02.076756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:33:02.076756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:33:02.076756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:33:02.076756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718 could not be found. Jun 07 14:33:02.076756 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:33:02.078232 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7e665af6-276a-4b2f-9a56-5598216651a2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Returning 404 to user: Instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718 could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:33:02.078232 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7e665af6-276a-4b2f-9a56-5598216651a2 tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 404 len: 111 microversion: 2.20 time: 0.029637 Jun 07 14:33:02.078232 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 469/974] 10.222.0.81 () {60 vars in 1279 bytes} [Tue Jun 7 14:33:02 2022] DELETE /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 14:33:02.082475 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-f4d97489-7da2-48b3-b881-e37c153169db tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:02.083095 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-f4d97489-7da2-48b3-b881-e37c153169db tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] [instance: a2ed6c33-30a8-4a3b-aba5-57610c2ec718] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:02.090422 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f4d97489-7da2-48b3-b881-e37c153169db tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:02.090874 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f4d97489-7da2-48b3-b881-e37c153169db tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:02.091672 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f4d97489-7da2-48b3-b881-e37c153169db tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:02.092112 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f4d97489-7da2-48b3-b881-e37c153169db tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:02.107978 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-f4d97489-7da2-48b3-b881-e37c153169db tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] HTTP exception thrown: Instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718 could not be found. Jun 07 14:33:02.109513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-f4d97489-7da2-48b3-b881-e37c153169db tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Request method failure captured: Jun 07 14:33:02.109513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 HTTP/1.1 Jun 07 14:33:02.109513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:33:02.109513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:33:02.109513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:33:02.109513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:33:02.109513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:33:02.109513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:33:02.109513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:33:02.109513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:33:02.109513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin2BvHw8qXohK6PwC1vEO7h5uuxZx_wOlISE40LeCzFaeGL69IFlImRQozIdjEBYOVrcVx2Zukqf3gYQtOz-oJaTLAqRfMx2wyPMTldZdiNF3yXFFqeoae4rO4M0pcxN31QXSFx33PHHi7fCBMk1qC9bjav0PveuTcxx9sWYL66eQMd8 Jun 07 14:33:02.109513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:33:02.109513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:33:02.109513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:33:02.109513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:33:02.109513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 14:33:02.109513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:33:02.109513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:33:02.109513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: 4c6a6f6bdf7743cba1a36a3e8f67cf02 Jun 07 14:33:02.109513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1238086752 Jun 07 14:33:02.109513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:33:02.109513 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:33:02.111202 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4c6a6f6bdf7743cba1a36a3e8f67cf02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4c6a6f6bdf7743cba1a36a3e8f67cf02", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4c6a6f6bdf7743cba1a36a3e8f67cf02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4c6a6f6bdf7743cba1a36a3e8f67cf02"}]}] Jun 07 14:33:02.111202 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1238086752 Jun 07 14:33:02.111202 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: 4c6a6f6bdf7743cba1a36a3e8f67cf02 Jun 07 14:33:02.111202 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1238086752 Jun 07 14:33:02.111202 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-AttachVolumeShelveTestJSON-1238086752-project Jun 07 14:33:02.111202 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:33:02.111202 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:33:02.111202 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: fefdd9dfa11641a598fcc29b2ad32afc Jun 07 14:33:02.111202 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1238086752-project Jun 07 14:33:02.111202 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:33:02.111202 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718 could not be found. Jun 07 14:33:02.111202 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': 'a2ed6c33-30a8-4a3b-aba5-57610c2ec718'} Jun 07 14:33:02.112153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:33:02.112153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:33:02.112153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:33:02.112153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:33:02.112153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:33:02.112153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:33:02.112153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:33:02.112153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:33:02.112153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:33:02.112153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:33:02.112153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718 could not be found. Jun 07 14:33:02.112153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:02.112153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:33:02.112153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:02.112153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:33:02.112153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:33:02.112153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:33:02.112153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:33:02.112153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:33:02.112153 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:33:02.113675 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:33:02.113675 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:33:02.113675 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:33:02.113675 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:33:02.113675 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:33:02.113675 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:33:02.113675 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:33:02.113675 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718 could not be found. Jun 07 14:33:02.113675 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:02.113675 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:33:02.113675 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:02.113675 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:33:02.113675 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:33:02.113675 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:33:02.113675 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:33:02.113675 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:33:02.113675 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718 could not be found. Jun 07 14:33:02.113675 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:02.115013 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-f4d97489-7da2-48b3-b881-e37c153169db tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] Returning 404 to user: Instance a2ed6c33-30a8-4a3b-aba5-57610c2ec718 could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:33:02.115013 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-f4d97489-7da2-48b3-b881-e37c153169db tempest-AttachVolumeShelveTestJSON-1238086752 tempest-AttachVolumeShelveTestJSON-1238086752-project] 10.222.0.81 "GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718" status: 404 len: 111 microversion: 2.20 time: 0.032355 Jun 07 14:33:02.115013 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 506/975] 10.222.0.81 () {60 vars in 1276 bytes} [Tue Jun 7 14:33:02 2022] GET /compute/v2.1/servers/a2ed6c33-30a8-4a3b-aba5-57610c2ec718 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 14:33:10.423054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b7e59982-b081-449f-afd7-50b15e2a5736 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Action: 'create', calling method: .version_select at 0x7ff37f6294c0>, body: {"keypair": {"name": "tempest-keypair-1614943308", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTaQU9XeIm9asGPcZlBYJqxDs3krK46lfYdkWoHeF0PLIHkzHv1LLfnTJCbL+6MzdcYh/By1QBYVeRaDGIKrYwOU9ShTcUtfXacfIQYimBY6wRWjbsSlNylQdG75CQixQ=="}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:33:10.439671 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-b7e59982-b081-449f-afd7-50b15e2a5736 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Getting quotas for project a68951caf41c425cb3e1335e30d52a3c. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:33:10.444155 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-b7e59982-b081-449f-afd7-50b15e2a5736 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Getting quotas for user a52df1ab67cb42b69f333adede204a61 and project a68951caf41c425cb3e1335e30d52a3c. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:33:10.457054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b7e59982-b081-449f-afd7-50b15e2a5736 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [c69c3a90-0da1-4a8c-8191-9b6dc89bfd73] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 07 14:33:11.464432 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO oslo.messaging._drivers.impl_rabbit [None req-b7e59982-b081-449f-afd7-50b15e2a5736 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [c69c3a90-0da1-4a8c-8191-9b6dc89bfd73] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 35336. Jun 07 14:33:11.479891 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b7e59982-b081-449f-afd7-50b15e2a5736 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.177054 Jun 07 14:33:11.480497 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 470/976] 10.222.0.81 () {60 vars in 1158 bytes} [Tue Jun 7 14:33:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:33:12.805226 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-cd9b978c-0609-46b6-bb35-76de1a30d0c5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1267913971", "imageRef": "2864004b-970a-480b-8453-14794f9ccca2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "33f78b17-9d5e-40c8-a0e8-fff86f3c9b61"}], "security_groups": [{"name": "tempest-securitygroup--894285122"}], "key_name": "tempest-keypair-1614943308", "user_data": "}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:33:12.812518 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:33:12.813157 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=22 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:33:12.930000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.network.neutron [None req-cd9b978c-0609-46b6-bb35-76de1a30d0c5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] validate_networks() for [('33f78b17-9d5e-40c8-a0e8-fff86f3c9b61', None, None, None, None, None)] {{(pid=117565) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:33:13.395507 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-cd9b978c-0609-46b6-bb35-76de1a30d0c5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Flavor limits 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:33:13.396154 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-cd9b978c-0609-46b6-bb35-76de1a30d0c5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Image limits 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:33:13.396629 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-cd9b978c-0609-46b6-bb35-76de1a30d0c5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Flavor pref 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:33:13.397040 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-cd9b978c-0609-46b6-bb35-76de1a30d0c5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Image pref 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:33:13.397452 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-cd9b978c-0609-46b6-bb35-76de1a30d0c5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:33:13.407575 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cd9b978c-0609-46b6-bb35-76de1a30d0c5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:13.408019 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cd9b978c-0609-46b6-bb35-76de1a30d0c5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:13.408804 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cd9b978c-0609-46b6-bb35-76de1a30d0c5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:13.409237 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cd9b978c-0609-46b6-bb35-76de1a30d0c5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:13.428284 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-cd9b978c-0609-46b6-bb35-76de1a30d0c5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Getting quotas for project a68951caf41c425cb3e1335e30d52a3c. Resources: {'ram', 'cores', 'instances'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:33:13.432853 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-cd9b978c-0609-46b6-bb35-76de1a30d0c5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Getting quotas for user a52df1ab67cb42b69f333adede204a61 and project a68951caf41c425cb3e1335e30d52a3c. Resources: {'ram', 'cores', 'instances'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:33:13.443958 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-cd9b978c-0609-46b6-bb35-76de1a30d0c5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Going to run 1 instances... {{(pid=117565) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:33:13.446231 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-cd9b978c-0609-46b6-bb35-76de1a30d0c5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2864004b-970a-480b-8453-14794f9ccca2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:33:13.495851 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-cd9b978c-0609-46b6-bb35-76de1a30d0c5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.694981 Jun 07 14:33:13.496566 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 507/977] 10.222.0.81 () {60 vars in 1146 bytes} [Tue Jun 7 14:33:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:33:13.506426 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f7c82276-9da9-4205-ab1d-6b3ac7ad177c tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:13.507049 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f7c82276-9da9-4205-ab1d-6b3ac7ad177c tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:13.510404 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:33:13.570592 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f7c82276-9da9-4205-ab1d-6b3ac7ad177c tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:33:13.578062 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f7c82276-9da9-4205-ab1d-6b3ac7ad177c tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38" status: 200 len: 1242 microversion: 2.1 time: 0.075399 Jun 07 14:33:13.578830 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 471/978] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:33:13 2022] GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38 => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:33:14.596824 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-6a4108cc-ee7d-4b96-bb62-be7ec8437b26 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:14.597442 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-6a4108cc-ee7d-4b96-bb62-be7ec8437b26 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:14.603830 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6a4108cc-ee7d-4b96-bb62-be7ec8437b26 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:14.604280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6a4108cc-ee7d-4b96-bb62-be7ec8437b26 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:14.605055 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6a4108cc-ee7d-4b96-bb62-be7ec8437b26 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:14.605493 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6a4108cc-ee7d-4b96-bb62-be7ec8437b26 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:14.666824 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-6a4108cc-ee7d-4b96-bb62-be7ec8437b26 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:33:14.674369 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-6a4108cc-ee7d-4b96-bb62-be7ec8437b26 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38" status: 200 len: 1300 microversion: 2.1 time: 0.082511 Jun 07 14:33:14.674959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 508/979] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:33:14 2022] GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38 => generated 1300 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:33:15.691523 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a670da13-3f64-4f07-8044-d1f1e3bde57b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:15.692147 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a670da13-3f64-4f07-8044-d1f1e3bde57b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:15.700322 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a670da13-3f64-4f07-8044-d1f1e3bde57b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:15.700784 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a670da13-3f64-4f07-8044-d1f1e3bde57b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:15.701551 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a670da13-3f64-4f07-8044-d1f1e3bde57b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:15.701984 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a670da13-3f64-4f07-8044-d1f1e3bde57b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:15.835544 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a670da13-3f64-4f07-8044-d1f1e3bde57b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:33:15.843070 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a670da13-3f64-4f07-8044-d1f1e3bde57b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38" status: 200 len: 1367 microversion: 2.1 time: 0.155430 Jun 07 14:33:15.843686 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 472/980] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:33:15 2022] GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:33:16.148663 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-b4f3e72c-ffc2-46ed-b991-0a688304e6fb req-f0d7101e-e9f4-4330-9c5c-91dd5393ee73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e8589c3-e05b-4799-b7d3-badddcf67d38", "tag": "efe6ad85-77cb-475a-8c69-a4e6f8c4bd6f"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:33:16.159628 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-b4f3e72c-ffc2-46ed-b991-0a688304e6fb req-f0d7101e-e9f4-4330-9c5c-91dd5393ee73 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:16.160364 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-b4f3e72c-ffc2-46ed-b991-0a688304e6fb req-f0d7101e-e9f4-4330-9c5c-91dd5393ee73 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:16.183910 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-b4f3e72c-ffc2-46ed-b991-0a688304e6fb req-f0d7101e-e9f4-4330-9c5c-91dd5393ee73 service nova] Creating event network-changed:efe6ad85-77cb-475a-8c69-a4e6f8c4bd6f for instance 3e8589c3-e05b-4799-b7d3-badddcf67d38 on hv-cinder-83608 Jun 07 14:33:16.191982 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-b4f3e72c-ffc2-46ed-b991-0a688304e6fb req-f0d7101e-e9f4-4330-9c5c-91dd5393ee73 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048126 Jun 07 14:33:16.193710 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 509/981] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:33:16.859888 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-090ff31a-94f4-4de3-abd7-63fe39a6fd05 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:16.860499 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-090ff31a-94f4-4de3-abd7-63fe39a6fd05 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:16.866602 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-090ff31a-94f4-4de3-abd7-63fe39a6fd05 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:16.867047 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-090ff31a-94f4-4de3-abd7-63fe39a6fd05 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:16.867860 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-090ff31a-94f4-4de3-abd7-63fe39a6fd05 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:16.868292 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-090ff31a-94f4-4de3-abd7-63fe39a6fd05 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:16.993984 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-090ff31a-94f4-4de3-abd7-63fe39a6fd05 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:33:17.001482 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-090ff31a-94f4-4de3-abd7-63fe39a6fd05 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38" status: 200 len: 1367 microversion: 2.1 time: 0.145468 Jun 07 14:33:17.002053 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 473/982] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:33:16 2022] GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:33:18.020011 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ebe42ed0-c121-41be-bc4d-2812299f7fd0 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:18.020841 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ebe42ed0-c121-41be-bc4d-2812299f7fd0 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:18.028413 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ebe42ed0-c121-41be-bc4d-2812299f7fd0 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:18.028867 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ebe42ed0-c121-41be-bc4d-2812299f7fd0 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:18.029643 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ebe42ed0-c121-41be-bc4d-2812299f7fd0 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:18.030079 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ebe42ed0-c121-41be-bc4d-2812299f7fd0 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:18.165131 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ebe42ed0-c121-41be-bc4d-2812299f7fd0 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:33:18.173547 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ebe42ed0-c121-41be-bc4d-2812299f7fd0 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38" status: 200 len: 1367 microversion: 2.1 time: 0.158540 Jun 07 14:33:18.174122 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 510/983] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:33:18 2022] GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:33:19.190344 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a4e70293-4c8c-4854-be02-cdafc1305096 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:19.190893 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a4e70293-4c8c-4854-be02-cdafc1305096 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:19.197413 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a4e70293-4c8c-4854-be02-cdafc1305096 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:19.198091 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a4e70293-4c8c-4854-be02-cdafc1305096 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:19.198857 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a4e70293-4c8c-4854-be02-cdafc1305096 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:19.199355 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a4e70293-4c8c-4854-be02-cdafc1305096 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:19.333786 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-a4e70293-4c8c-4854-be02-cdafc1305096 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:33:19.341930 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a4e70293-4c8c-4854-be02-cdafc1305096 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38" status: 200 len: 1367 microversion: 2.1 time: 0.155512 Jun 07 14:33:19.342492 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 474/984] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:33:19 2022] GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:33:20.359091 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-fab88230-0a33-40d2-bac0-abed1514480b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:20.359715 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-fab88230-0a33-40d2-bac0-abed1514480b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:20.365769 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fab88230-0a33-40d2-bac0-abed1514480b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:20.366219 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fab88230-0a33-40d2-bac0-abed1514480b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:20.366981 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fab88230-0a33-40d2-bac0-abed1514480b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:20.367464 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-fab88230-0a33-40d2-bac0-abed1514480b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:20.494291 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-fab88230-0a33-40d2-bac0-abed1514480b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:33:20.502635 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-fab88230-0a33-40d2-bac0-abed1514480b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38" status: 200 len: 1367 microversion: 2.1 time: 0.147706 Jun 07 14:33:20.503203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 511/985] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:33:20 2022] GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:33:21.519753 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-45dbc431-5ce6-4725-9d8d-007d8422a033 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:21.520375 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-45dbc431-5ce6-4725-9d8d-007d8422a033 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:21.527712 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-45dbc431-5ce6-4725-9d8d-007d8422a033 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:21.528164 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-45dbc431-5ce6-4725-9d8d-007d8422a033 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:21.528925 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-45dbc431-5ce6-4725-9d8d-007d8422a033 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:21.529363 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-45dbc431-5ce6-4725-9d8d-007d8422a033 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:21.666246 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-45dbc431-5ce6-4725-9d8d-007d8422a033 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:33:21.673921 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-45dbc431-5ce6-4725-9d8d-007d8422a033 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38" status: 200 len: 1367 microversion: 2.1 time: 0.158002 Jun 07 14:33:21.674511 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 475/986] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:33:21 2022] GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:33:21.748280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-835470e6-752a-4c4b-83c0-b531070f4473 req-e72e14d8-4f81-48b5-8ee6-bfea872a4247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e8589c3-e05b-4799-b7d3-badddcf67d38", "name": "network-vif-plugged", "status": "completed", "tag": "efe6ad85-77cb-475a-8c69-a4e6f8c4bd6f"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:33:21.756922 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-835470e6-752a-4c4b-83c0-b531070f4473 req-e72e14d8-4f81-48b5-8ee6-bfea872a4247 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:21.757464 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-835470e6-752a-4c4b-83c0-b531070f4473 req-e72e14d8-4f81-48b5-8ee6-bfea872a4247 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:21.769853 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-835470e6-752a-4c4b-83c0-b531070f4473 req-e72e14d8-4f81-48b5-8ee6-bfea872a4247 service nova] Creating event network-vif-plugged:efe6ad85-77cb-475a-8c69-a4e6f8c4bd6f for instance 3e8589c3-e05b-4799-b7d3-badddcf67d38 on hv-cinder-83608 Jun 07 14:33:21.774719 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-835470e6-752a-4c4b-83c0-b531070f4473 req-e72e14d8-4f81-48b5-8ee6-bfea872a4247 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030644 Jun 07 14:33:21.775350 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 512/987] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:33:22.691386 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-70c4cb43-041e-4587-a181-ea03dd318643 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:22.692012 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-70c4cb43-041e-4587-a181-ea03dd318643 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:22.699374 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-70c4cb43-041e-4587-a181-ea03dd318643 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:22.699824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-70c4cb43-041e-4587-a181-ea03dd318643 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:22.700596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-70c4cb43-041e-4587-a181-ea03dd318643 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:22.701035 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-70c4cb43-041e-4587-a181-ea03dd318643 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:22.830136 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-70c4cb43-041e-4587-a181-ea03dd318643 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:33:22.837531 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-70c4cb43-041e-4587-a181-ea03dd318643 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38" status: 200 len: 1367 microversion: 2.1 time: 0.150149 Jun 07 14:33:22.838096 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 476/988] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:33:22 2022] GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:33:23.852641 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=2 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:33:23.853402 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=6 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:33:23.858165 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ad1dddd4-4e86-4fa1-be65-ba546656c286 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:23.858871 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ad1dddd4-4e86-4fa1-be65-ba546656c286 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:23.865953 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ad1dddd4-4e86-4fa1-be65-ba546656c286 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:23.866400 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ad1dddd4-4e86-4fa1-be65-ba546656c286 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:23.867161 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ad1dddd4-4e86-4fa1-be65-ba546656c286 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:23.867629 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ad1dddd4-4e86-4fa1-be65-ba546656c286 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:23.997843 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ad1dddd4-4e86-4fa1-be65-ba546656c286 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:33:24.005704 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ad1dddd4-4e86-4fa1-be65-ba546656c286 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38" status: 200 len: 1557 microversion: 2.1 time: 0.154461 Jun 07 14:33:24.013527 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 513/989] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:33:23 2022] GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:33:24.022570 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e31ad3ad-df57-46e7-b36a-4df73a51146b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:24.022944 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e31ad3ad-df57-46e7-b36a-4df73a51146b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:24.024867 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=6 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:33:24.031640 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e31ad3ad-df57-46e7-b36a-4df73a51146b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:24.032097 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e31ad3ad-df57-46e7-b36a-4df73a51146b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:24.032867 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e31ad3ad-df57-46e7-b36a-4df73a51146b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:24.033306 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e31ad3ad-df57-46e7-b36a-4df73a51146b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:24.115424 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e31ad3ad-df57-46e7-b36a-4df73a51146b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096807 Jun 07 14:33:24.116021 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 477/990] 10.222.0.81 () {58 vars in 1274 bytes} [Tue Jun 7 14:33:24 2022] GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:33:25.392714 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-16721d3b-5a04-4bd8-bc85-d25b13a635b3 req-dea4eb2f-2345-4898-8bdf-4c143586b0ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e8589c3-e05b-4799-b7d3-badddcf67d38", "tag": "efe6ad85-77cb-475a-8c69-a4e6f8c4bd6f"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:33:25.400694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-16721d3b-5a04-4bd8-bc85-d25b13a635b3 req-dea4eb2f-2345-4898-8bdf-4c143586b0ae service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:25.401132 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-16721d3b-5a04-4bd8-bc85-d25b13a635b3 req-dea4eb2f-2345-4898-8bdf-4c143586b0ae service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:25.412155 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-16721d3b-5a04-4bd8-bc85-d25b13a635b3 req-dea4eb2f-2345-4898-8bdf-4c143586b0ae service nova] Creating event network-changed:efe6ad85-77cb-475a-8c69-a4e6f8c4bd6f for instance 3e8589c3-e05b-4799-b7d3-badddcf67d38 on hv-cinder-83608 Jun 07 14:33:25.417053 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-16721d3b-5a04-4bd8-bc85-d25b13a635b3 req-dea4eb2f-2345-4898-8bdf-4c143586b0ae service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141397 Jun 07 14:33:25.417694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 514/991] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:33:31.740981 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-88c71c9c-b1de-45cf-bc6b-4e2c2ea89e68 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:31.741526 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-88c71c9c-b1de-45cf-bc6b-4e2c2ea89e68 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 25aa543f-396c-46d5-a8b6-2eb21e172198] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:31.743103 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-ca13ac52-4d57-4b57-98fb-efb79fbc739d req-40161d7a-3c63-49ef-9e37-d127a167a8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25aa543f-396c-46d5-a8b6-2eb21e172198", "tag": "2122f609-8a6d-4e5d-bfcb-9d9443103453"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:33:31.744626 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:33:31.749917 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-88c71c9c-b1de-45cf-bc6b-4e2c2ea89e68 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:31.750438 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-88c71c9c-b1de-45cf-bc6b-4e2c2ea89e68 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:31.752324 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-88c71c9c-b1de-45cf-bc6b-4e2c2ea89e68 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:31.753246 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-88c71c9c-b1de-45cf-bc6b-4e2c2ea89e68 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:31.754354 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-ca13ac52-4d57-4b57-98fb-efb79fbc739d req-40161d7a-3c63-49ef-9e37-d127a167a8e7 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:31.754980 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-ca13ac52-4d57-4b57-98fb-efb79fbc739d req-40161d7a-3c63-49ef-9e37-d127a167a8e7 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:31.773355 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-ca13ac52-4d57-4b57-98fb-efb79fbc739d req-40161d7a-3c63-49ef-9e37-d127a167a8e7 service nova] Creating event network-changed:2122f609-8a6d-4e5d-bfcb-9d9443103453 for instance 25aa543f-396c-46d5-a8b6-2eb21e172198 on hv-cinder-83608 Jun 07 14:33:31.779130 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-ca13ac52-4d57-4b57-98fb-efb79fbc739d req-40161d7a-3c63-49ef-9e37-d127a167a8e7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041172 Jun 07 14:33:31.780592 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 515/992] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:33:31.785700 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-88c71c9c-b1de-45cf-bc6b-4e2c2ea89e68 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 25aa543f-396c-46d5-a8b6-2eb21e172198] Going to try to terminate instance {{(pid=117564) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:33:31.875022 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-88c71c9c-b1de-45cf-bc6b-4e2c2ea89e68 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "DELETE /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198" status: 204 len: 0 microversion: 2.1 time: 0.139647 Jun 07 14:33:31.879875 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 478/993] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:33:31 2022] DELETE /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:33:31.885411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-19f000e8-f46c-4f9a-bd76-00ed328bdc4e tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:31.886118 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-19f000e8-f46c-4f9a-bd76-00ed328bdc4e tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 25aa543f-396c-46d5-a8b6-2eb21e172198] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:31.893389 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-19f000e8-f46c-4f9a-bd76-00ed328bdc4e tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:31.893846 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-19f000e8-f46c-4f9a-bd76-00ed328bdc4e tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:31.894770 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-19f000e8-f46c-4f9a-bd76-00ed328bdc4e tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:31.895239 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-19f000e8-f46c-4f9a-bd76-00ed328bdc4e tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:32.035518 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-19f000e8-f46c-4f9a-bd76-00ed328bdc4e tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:33:32.043709 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-19f000e8-f46c-4f9a-bd76-00ed328bdc4e tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198" status: 200 len: 1578 microversion: 2.1 time: 0.162807 Jun 07 14:33:32.044461 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 516/994] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:33:31 2022] GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:33:33.061975 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-f49dd4d8-903e-400f-9d38-4947e5307734 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:33.062596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-f49dd4d8-903e-400f-9d38-4947e5307734 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 25aa543f-396c-46d5-a8b6-2eb21e172198] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:33.069453 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f49dd4d8-903e-400f-9d38-4947e5307734 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:33.069902 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f49dd4d8-903e-400f-9d38-4947e5307734 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:33.070707 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f49dd4d8-903e-400f-9d38-4947e5307734 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:33.071145 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-f49dd4d8-903e-400f-9d38-4947e5307734 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:33.216688 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-f49dd4d8-903e-400f-9d38-4947e5307734 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:33:33.224555 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-f49dd4d8-903e-400f-9d38-4947e5307734 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198" status: 200 len: 1578 microversion: 2.1 time: 0.167033 Jun 07 14:33:33.225129 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 479/995] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:33:33 2022] GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:33:33.980752 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-85a286b2-a52b-40f0-bba5-eb22d6399aeb req-adfd8321-46cf-42c9-ac09-a90a98c32582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25aa543f-396c-46d5-a8b6-2eb21e172198", "name": "network-vif-deleted", "tag": "2122f609-8a6d-4e5d-bfcb-9d9443103453"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:33:33.989480 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-85a286b2-a52b-40f0-bba5-eb22d6399aeb req-adfd8321-46cf-42c9-ac09-a90a98c32582 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:33.990009 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-85a286b2-a52b-40f0-bba5-eb22d6399aeb req-adfd8321-46cf-42c9-ac09-a90a98c32582 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:34.002451 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-85a286b2-a52b-40f0-bba5-eb22d6399aeb req-adfd8321-46cf-42c9-ac09-a90a98c32582 service nova] Creating event network-vif-deleted:2122f609-8a6d-4e5d-bfcb-9d9443103453 for instance 25aa543f-396c-46d5-a8b6-2eb21e172198 on hv-cinder-83608 Jun 07 14:33:34.007341 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-85a286b2-a52b-40f0-bba5-eb22d6399aeb req-adfd8321-46cf-42c9-ac09-a90a98c32582 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030688 Jun 07 14:33:34.008028 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 517/996] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:33:34.241973 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8902d3ad-0c16-4a85-b13c-7825ec36376b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:34.242587 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8902d3ad-0c16-4a85-b13c-7825ec36376b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 25aa543f-396c-46d5-a8b6-2eb21e172198] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:34.249775 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8902d3ad-0c16-4a85-b13c-7825ec36376b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:34.250229 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8902d3ad-0c16-4a85-b13c-7825ec36376b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:34.251014 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8902d3ad-0c16-4a85-b13c-7825ec36376b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:34.251486 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8902d3ad-0c16-4a85-b13c-7825ec36376b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:34.286612 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8902d3ad-0c16-4a85-b13c-7825ec36376b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:34.287082 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8902d3ad-0c16-4a85-b13c-7825ec36376b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:34.287747 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-8902d3ad-0c16-4a85-b13c-7825ec36376b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lazy-loading 'fault' on Instance uuid 25aa543f-396c-46d5-a8b6-2eb21e172198 {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:33:34.332520 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8902d3ad-0c16-4a85-b13c-7825ec36376b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:33:34.341169 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8902d3ad-0c16-4a85-b13c-7825ec36376b tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198" status: 200 len: 1230 microversion: 2.1 time: 0.103544 Jun 07 14:33:34.341982 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 480/997] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:33:34 2022] GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:33:35.361314 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-a20b9c64-f2c2-4aa7-ae37-29bf8c7c407d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:35.362036 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-a20b9c64-f2c2-4aa7-ae37-29bf8c7c407d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 25aa543f-396c-46d5-a8b6-2eb21e172198] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:35.368191 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a20b9c64-f2c2-4aa7-ae37-29bf8c7c407d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:35.368638 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a20b9c64-f2c2-4aa7-ae37-29bf8c7c407d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:35.369398 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a20b9c64-f2c2-4aa7-ae37-29bf8c7c407d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:35.369829 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a20b9c64-f2c2-4aa7-ae37-29bf8c7c407d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:35.383522 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-a20b9c64-f2c2-4aa7-ae37-29bf8c7c407d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] HTTP exception thrown: Instance 25aa543f-396c-46d5-a8b6-2eb21e172198 could not be found. Jun 07 14:33:35.385265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-a20b9c64-f2c2-4aa7-ae37-29bf8c7c407d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Request method failure captured: Jun 07 14:33:35.385265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198 HTTP/1.1 Jun 07 14:33:35.385265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:33:35.385265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:33:35.385265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:33:35.385265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:33:35.385265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:33:35.385265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:33:35.385265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:33:35.385265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:33:35.385265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin2AYcIQp1UpZVWAvyl38WaYCMNW3yjqYupSPwUfIEV0pMBdPDiO_POFxBAdNlwjmzA2RngwAWba1QMnW_xcFiA5EZ-2A6ENxJn9QaSyZDrNkVISRAUmdwhDLHuJAaj_1uLen5V_B-mA2IM_0EGQmmCwNPaptfv3uQR27LdUirZHoB5k Jun 07 14:33:35.385265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:33:35.385265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:33:35.385265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:33:35.385265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:33:35.385265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:33:35.385265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:33:35.385265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: 6ee52855d08e467f9d2f02685d7bf541 Jun 07 14:33:35.385265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-TestVolumeBootPattern-1981564424 Jun 07 14:33:35.385265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:33:35.385265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:33:35.387134 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6ee52855d08e467f9d2f02685d7bf541"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6ee52855d08e467f9d2f02685d7bf541", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6ee52855d08e467f9d2f02685d7bf541"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6ee52855d08e467f9d2f02685d7bf541"}]}] Jun 07 14:33:35.387134 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-TestVolumeBootPattern-1981564424 Jun 07 14:33:35.387134 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: 6ee52855d08e467f9d2f02685d7bf541 Jun 07 14:33:35.387134 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-TestVolumeBootPattern-1981564424 Jun 07 14:33:35.387134 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-TestVolumeBootPattern-1981564424-project Jun 07 14:33:35.387134 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:33:35.387134 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:33:35.387134 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: d0b828a3dca14f2283a16894364d6eef Jun 07 14:33:35.387134 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-TestVolumeBootPattern-1981564424-project Jun 07 14:33:35.387134 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:33:35.387134 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance 25aa543f-396c-46d5-a8b6-2eb21e172198 could not be found. Jun 07 14:33:35.387134 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': '25aa543f-396c-46d5-a8b6-2eb21e172198'} Jun 07 14:33:35.391273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:33:35.391273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:33:35.391273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:33:35.391273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:33:35.391273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:33:35.391273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:33:35.391273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:33:35.391273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:33:35.391273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:33:35.391273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:33:35.391273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25aa543f-396c-46d5-a8b6-2eb21e172198 could not be found. Jun 07 14:33:35.391273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:35.391273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:33:35.391273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:35.391273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:33:35.391273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:33:35.391273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:33:35.391273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:33:35.391273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:33:35.391273 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:33:35.393821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:33:35.393821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:33:35.393821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:33:35.393821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:33:35.393821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:33:35.393821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:33:35.393821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:33:35.393821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25aa543f-396c-46d5-a8b6-2eb21e172198 could not be found. Jun 07 14:33:35.393821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:35.393821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:33:35.393821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:35.393821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:33:35.393821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:33:35.393821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:33:35.393821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:33:35.393821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:33:35.393821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25aa543f-396c-46d5-a8b6-2eb21e172198 could not be found. Jun 07 14:33:35.393821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:35.395294 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-a20b9c64-f2c2-4aa7-ae37-29bf8c7c407d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Returning 404 to user: Instance 25aa543f-396c-46d5-a8b6-2eb21e172198 could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:33:35.395294 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-a20b9c64-f2c2-4aa7-ae37-29bf8c7c407d tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198" status: 404 len: 111 microversion: 2.1 time: 0.030100 Jun 07 14:33:35.395294 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 518/998] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:33:35 2022] GET /compute/v2.1/servers/25aa543f-396c-46d5-a8b6-2eb21e172198 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:33:38.426602 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1959f211-5688-4417-8940-0c8691672a1a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:38.427210 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1959f211-5688-4417-8940-0c8691672a1a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:38.429322 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-e2342799-2506-4a1c-885e-067f2604355f req-867eb820-a2df-41dc-afeb-515033696783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c291fe41-2937-47d4-b460-bacb77437438", "tag": "8116f16b-8bdf-45d6-b0d0-8c403dbe11a9"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:33:38.435009 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1959f211-5688-4417-8940-0c8691672a1a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:38.435560 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1959f211-5688-4417-8940-0c8691672a1a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:38.436426 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1959f211-5688-4417-8940-0c8691672a1a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:38.436931 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1959f211-5688-4417-8940-0c8691672a1a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:38.438659 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-e2342799-2506-4a1c-885e-067f2604355f req-867eb820-a2df-41dc-afeb-515033696783 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:38.439102 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-e2342799-2506-4a1c-885e-067f2604355f req-867eb820-a2df-41dc-afeb-515033696783 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:38.450849 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-e2342799-2506-4a1c-885e-067f2604355f req-867eb820-a2df-41dc-afeb-515033696783 service nova] Creating event network-changed:8116f16b-8bdf-45d6-b0d0-8c403dbe11a9 for instance c291fe41-2937-47d4-b460-bacb77437438 on hv-cinder-83608 Jun 07 14:33:38.456362 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-e2342799-2506-4a1c-885e-067f2604355f req-867eb820-a2df-41dc-afeb-515033696783 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031264 Jun 07 14:33:38.457571 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 519/999] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:33:38.462906 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1959f211-5688-4417-8940-0c8691672a1a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Going to try to terminate instance {{(pid=117564) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:33:38.551846 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1959f211-5688-4417-8940-0c8691672a1a tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 204 len: 0 microversion: 2.1 time: 0.128533 Jun 07 14:33:38.556034 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 481/1000] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:33:38 2022] DELETE /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:33:38.564693 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-1c744ab4-007e-4e88-add3-c629f5c819d7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:38.565514 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-1c744ab4-007e-4e88-add3-c629f5c819d7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:38.572333 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1c744ab4-007e-4e88-add3-c629f5c819d7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:38.573027 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1c744ab4-007e-4e88-add3-c629f5c819d7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:38.574105 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1c744ab4-007e-4e88-add3-c629f5c819d7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:38.574566 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1c744ab4-007e-4e88-add3-c629f5c819d7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:38.738505 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-1c744ab4-007e-4e88-add3-c629f5c819d7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:33:38.746933 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-1c744ab4-007e-4e88-add3-c629f5c819d7 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 200 len: 1577 microversion: 2.1 time: 0.189384 Jun 07 14:33:38.747596 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 520/1001] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:33:38 2022] GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 1577 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:33:39.765448 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-bfa94ac3-10f6-49d3-a5b7-9b4f712bcd99 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:39.766155 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-bfa94ac3-10f6-49d3-a5b7-9b4f712bcd99 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:39.772554 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bfa94ac3-10f6-49d3-a5b7-9b4f712bcd99 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:39.773003 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bfa94ac3-10f6-49d3-a5b7-9b4f712bcd99 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:39.773765 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bfa94ac3-10f6-49d3-a5b7-9b4f712bcd99 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:39.774232 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bfa94ac3-10f6-49d3-a5b7-9b4f712bcd99 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:39.984115 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-bfa94ac3-10f6-49d3-a5b7-9b4f712bcd99 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:33:39.991703 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-bfa94ac3-10f6-49d3-a5b7-9b4f712bcd99 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 200 len: 1577 microversion: 2.1 time: 0.231140 Jun 07 14:33:39.992277 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 482/1002] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:33:39 2022] GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 1577 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:33:40.600020 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-32d3649a-db03-42cb-9549-9e641dedffd1 req-c5fc4c80-6677-4ae5-b1df-eaff8bc62a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c291fe41-2937-47d4-b460-bacb77437438", "name": "network-vif-deleted", "tag": "8116f16b-8bdf-45d6-b0d0-8c403dbe11a9"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:33:40.609894 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-32d3649a-db03-42cb-9549-9e641dedffd1 req-c5fc4c80-6677-4ae5-b1df-eaff8bc62a02 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:40.610338 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-32d3649a-db03-42cb-9549-9e641dedffd1 req-c5fc4c80-6677-4ae5-b1df-eaff8bc62a02 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:40.623045 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-32d3649a-db03-42cb-9549-9e641dedffd1 req-c5fc4c80-6677-4ae5-b1df-eaff8bc62a02 service nova] Creating event network-vif-deleted:8116f16b-8bdf-45d6-b0d0-8c403dbe11a9 for instance c291fe41-2937-47d4-b460-bacb77437438 on hv-cinder-83608 Jun 07 14:33:40.628010 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-32d3649a-db03-42cb-9549-9e641dedffd1 req-c5fc4c80-6677-4ae5-b1df-eaff8bc62a02 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031860 Jun 07 14:33:40.628606 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 521/1003] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:33:41.008596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-92b0e817-49b4-439d-8653-64190eb6e390 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:41.009219 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-92b0e817-49b4-439d-8653-64190eb6e390 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:41.016462 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-92b0e817-49b4-439d-8653-64190eb6e390 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:41.016939 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-92b0e817-49b4-439d-8653-64190eb6e390 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:41.017676 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-92b0e817-49b4-439d-8653-64190eb6e390 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:41.018115 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-92b0e817-49b4-439d-8653-64190eb6e390 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:41.048875 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-92b0e817-49b4-439d-8653-64190eb6e390 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:41.049325 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-92b0e817-49b4-439d-8653-64190eb6e390 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:41.049775 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-92b0e817-49b4-439d-8653-64190eb6e390 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lazy-loading 'fault' on Instance uuid c291fe41-2937-47d4-b460-bacb77437438 {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:33:41.090895 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-92b0e817-49b4-439d-8653-64190eb6e390 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b828a3dca14f2283a16894364d6eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee52855d08e467f9d2f02685d7bf541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:33:41.098641 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-92b0e817-49b4-439d-8653-64190eb6e390 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 200 len: 1230 microversion: 2.1 time: 0.093923 Jun 07 14:33:41.099207 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 483/1004] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:33:41 2022] GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 1230 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:33:42.116699 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-258686fa-1866-4198-8403-536e52d23d1c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:42.117436 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-258686fa-1866-4198-8403-536e52d23d1c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: c291fe41-2937-47d4-b460-bacb77437438] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:42.123862 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-258686fa-1866-4198-8403-536e52d23d1c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:42.124312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-258686fa-1866-4198-8403-536e52d23d1c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:42.125079 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-258686fa-1866-4198-8403-536e52d23d1c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:42.125519 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-258686fa-1866-4198-8403-536e52d23d1c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:42.139199 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-258686fa-1866-4198-8403-536e52d23d1c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] HTTP exception thrown: Instance c291fe41-2937-47d4-b460-bacb77437438 could not be found. Jun 07 14:33:42.140825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-258686fa-1866-4198-8403-536e52d23d1c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Request method failure captured: Jun 07 14:33:42.140825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 HTTP/1.1 Jun 07 14:33:42.140825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:33:42.140825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:33:42.140825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:33:42.140825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:33:42.140825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:33:42.140825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:33:42.140825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:33:42.140825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:33:42.140825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin2AYcIQp1UpZVWAvyl38WaYCMNW3yjqYupSPwUfIEV0pMBdPDiO_POFxBAdNlwjmzA2RngwAWba1QMnW_xcFiA5EZ-2A6ENxJn9QaSyZDrNkVISRAUmdwhDLHuJAaj_1uLen5V_B-mA2IM_0EGQmmCwNPaptfv3uQR27LdUirZHoB5k Jun 07 14:33:42.140825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:33:42.140825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:33:42.140825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:33:42.140825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:33:42.140825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:33:42.140825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:33:42.140825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: 6ee52855d08e467f9d2f02685d7bf541 Jun 07 14:33:42.140825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-TestVolumeBootPattern-1981564424 Jun 07 14:33:42.140825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:33:42.140825 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:33:42.142272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6ee52855d08e467f9d2f02685d7bf541"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6ee52855d08e467f9d2f02685d7bf541", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6ee52855d08e467f9d2f02685d7bf541"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6ee52855d08e467f9d2f02685d7bf541"}]}] Jun 07 14:33:42.142272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-TestVolumeBootPattern-1981564424 Jun 07 14:33:42.142272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: 6ee52855d08e467f9d2f02685d7bf541 Jun 07 14:33:42.142272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-TestVolumeBootPattern-1981564424 Jun 07 14:33:42.142272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-TestVolumeBootPattern-1981564424-project Jun 07 14:33:42.142272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:33:42.142272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:33:42.142272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: d0b828a3dca14f2283a16894364d6eef Jun 07 14:33:42.142272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-TestVolumeBootPattern-1981564424-project Jun 07 14:33:42.142272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:33:42.142272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance c291fe41-2937-47d4-b460-bacb77437438 could not be found. Jun 07 14:33:42.142272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': 'c291fe41-2937-47d4-b460-bacb77437438'} Jun 07 14:33:42.143061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:33:42.143061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:33:42.143061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:33:42.143061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:33:42.143061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:33:42.143061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:33:42.143061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:33:42.143061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:33:42.143061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:33:42.143061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:33:42.143061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c291fe41-2937-47d4-b460-bacb77437438 could not be found. Jun 07 14:33:42.143061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:42.143061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:33:42.143061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:42.143061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:33:42.143061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:33:42.143061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:33:42.143061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:33:42.143061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:33:42.143061 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:33:42.144583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:33:42.144583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:33:42.144583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:33:42.144583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:33:42.144583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:33:42.144583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:33:42.144583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:33:42.144583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c291fe41-2937-47d4-b460-bacb77437438 could not be found. Jun 07 14:33:42.144583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:42.144583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:33:42.144583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:42.144583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:33:42.144583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:33:42.144583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:33:42.144583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:33:42.144583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:33:42.144583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c291fe41-2937-47d4-b460-bacb77437438 could not be found. Jun 07 14:33:42.144583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:42.145960 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-258686fa-1866-4198-8403-536e52d23d1c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Returning 404 to user: Instance c291fe41-2937-47d4-b460-bacb77437438 could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:33:42.145960 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-258686fa-1866-4198-8403-536e52d23d1c tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438" status: 404 len: 111 microversion: 2.1 time: 0.030200 Jun 07 14:33:42.145960 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 522/1005] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:33:42 2022] GET /compute/v2.1/servers/c291fe41-2937-47d4-b460-bacb77437438 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:33:42.581858 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2adecf43-104e-4670-a5da-3e09bad99928 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:42.582387 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2adecf43-104e-4670-a5da-3e09bad99928 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:42.588834 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2adecf43-104e-4670-a5da-3e09bad99928 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:42.589290 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2adecf43-104e-4670-a5da-3e09bad99928 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:42.590274 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2adecf43-104e-4670-a5da-3e09bad99928 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:42.590720 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2adecf43-104e-4670-a5da-3e09bad99928 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:42.604032 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-2adecf43-104e-4670-a5da-3e09bad99928 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] HTTP exception thrown: Instance 99bfe151-4396-4c86-9fb5-f26989972141 could not be found. Jun 07 14:33:42.605937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2adecf43-104e-4670-a5da-3e09bad99928 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Request method failure captured: Jun 07 14:33:42.605937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: request: DELETE /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 HTTP/1.1 Jun 07 14:33:42.605937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 07 14:33:42.605937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 07 14:33:42.605937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Connection: close Jun 07 14:33:42.605937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 07 14:33:42.605937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 07 14:33:42.605937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Host: 10.222.0.81 Jun 07 14:33:42.605937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 07 14:33:42.605937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 07 14:33:42.605937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABin2AYcIQp1UpZVWAvyl38WaYCMNW3yjqYupSPwUfIEV0pMBdPDiO_POFxBAdNlwjmzA2RngwAWba1QMnW_xcFiA5EZ-2A6ENxJn9QaSyZDrNkVISRAUmdwhDLHuJAaj_1uLen5V_B-mA2IM_0EGQmmCwNPaptfv3uQR27LdUirZHoB5k Jun 07 14:33:42.605937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 07 14:33:42.605937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 07 14:33:42.605937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 07 14:33:42.605937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 07 14:33:42.605937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 07 14:33:42.605937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 07 14:33:42.605937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Id: 6ee52855d08e467f9d2f02685d7bf541 Jun 07 14:33:42.605937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-TestVolumeBootPattern-1981564424 Jun 07 14:33:42.605937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Role: member,reader Jun 07 14:33:42.605937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Roles: member,reader Jun 07 14:33:42.607653 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6ee52855d08e467f9d2f02685d7bf541"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6ee52855d08e467f9d2f02685d7bf541", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6ee52855d08e467f9d2f02685d7bf541"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6ee52855d08e467f9d2f02685d7bf541"}]}] Jun 07 14:33:42.607653 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-TestVolumeBootPattern-1981564424 Jun 07 14:33:42.607653 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Id: 6ee52855d08e467f9d2f02685d7bf541 Jun 07 14:33:42.607653 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-TestVolumeBootPattern-1981564424 Jun 07 14:33:42.607653 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User: tempest-TestVolumeBootPattern-1981564424-project Jun 07 14:33:42.607653 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 07 14:33:42.607653 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 07 14:33:42.607653 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Id: d0b828a3dca14f2283a16894364d6eef Jun 07 14:33:42.607653 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-TestVolumeBootPattern-1981564424-project Jun 07 14:33:42.607653 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: method: > Jun 07 14:33:42.607653 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: exception: Instance 99bfe151-4396-4c86-9fb5-f26989972141 could not be found. Jun 07 14:33:42.607653 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: action_args: {'id': '99bfe151-4396-4c86-9fb5-f26989972141'} Jun 07 14:33:42.608484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:33:42.608484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:33:42.608484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:33:42.608484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:33:42.608484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:33:42.608484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:33:42.608484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:33:42.608484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:33:42.608484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:33:42.608484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:33:42.608484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99bfe151-4396-4c86-9fb5-f26989972141 could not be found. Jun 07 14:33:42.608484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:33:42.608484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:33:42.608484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:33:42.608484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:33:42.608484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:33:42.608484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:33:42.608484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:33:42.608484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:33:42.608484 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:33:42.609841 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:33:42.609841 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 14:33:42.609841 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 14:33:42.609841 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 14:33:42.609841 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 14:33:42.609841 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:33:42.609841 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:33:42.609841 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:33:42.609841 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:33:42.609841 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99bfe151-4396-4c86-9fb5-f26989972141 could not be found. Jun 07 14:33:42.609841 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:33:42.609841 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:33:42.609841 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:33:42.609841 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:33:42.609841 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:33:42.609841 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:33:42.609841 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:33:42.609841 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:33:42.609841 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99bfe151-4396-4c86-9fb5-f26989972141 could not be found. Jun 07 14:33:42.609841 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:33:42.611200 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2adecf43-104e-4670-a5da-3e09bad99928 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Returning 404 to user: Instance 99bfe151-4396-4c86-9fb5-f26989972141 could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:33:42.611200 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2adecf43-104e-4670-a5da-3e09bad99928 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "DELETE /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141" status: 404 len: 111 microversion: 2.1 time: 0.029321 Jun 07 14:33:42.611200 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 484/1006] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:33:42 2022] DELETE /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:33:42.615806 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-cc1e2852-187b-4429-9b70-80c735a6e2c2 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:42.616448 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-cc1e2852-187b-4429-9b70-80c735a6e2c2 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] [instance: 99bfe151-4396-4c86-9fb5-f26989972141] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:33:42.623146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cc1e2852-187b-4429-9b70-80c735a6e2c2 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:42.623631 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cc1e2852-187b-4429-9b70-80c735a6e2c2 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:42.624404 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cc1e2852-187b-4429-9b70-80c735a6e2c2 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:33:42.624848 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cc1e2852-187b-4429-9b70-80c735a6e2c2 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:33:42.639158 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-cc1e2852-187b-4429-9b70-80c735a6e2c2 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] HTTP exception thrown: Instance 99bfe151-4396-4c86-9fb5-f26989972141 could not be found. Jun 07 14:33:42.640742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-cc1e2852-187b-4429-9b70-80c735a6e2c2 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Request method failure captured: Jun 07 14:33:42.640742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 HTTP/1.1 Jun 07 14:33:42.640742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:33:42.640742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:33:42.640742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:33:42.640742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:33:42.640742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:33:42.640742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:33:42.640742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:33:42.640742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:33:42.640742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin2AYcIQp1UpZVWAvyl38WaYCMNW3yjqYupSPwUfIEV0pMBdPDiO_POFxBAdNlwjmzA2RngwAWba1QMnW_xcFiA5EZ-2A6ENxJn9QaSyZDrNkVISRAUmdwhDLHuJAaj_1uLen5V_B-mA2IM_0EGQmmCwNPaptfv3uQR27LdUirZHoB5k Jun 07 14:33:42.640742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:33:42.640742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:33:42.640742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:33:42.640742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:33:42.640742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:33:42.640742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:33:42.640742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: 6ee52855d08e467f9d2f02685d7bf541 Jun 07 14:33:42.640742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-TestVolumeBootPattern-1981564424 Jun 07 14:33:42.640742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:33:42.640742 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:33:42.642460 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6ee52855d08e467f9d2f02685d7bf541"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6ee52855d08e467f9d2f02685d7bf541", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6ee52855d08e467f9d2f02685d7bf541"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6ee52855d08e467f9d2f02685d7bf541"}]}] Jun 07 14:33:42.642460 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-TestVolumeBootPattern-1981564424 Jun 07 14:33:42.642460 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: 6ee52855d08e467f9d2f02685d7bf541 Jun 07 14:33:42.642460 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-TestVolumeBootPattern-1981564424 Jun 07 14:33:42.642460 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-TestVolumeBootPattern-1981564424-project Jun 07 14:33:42.642460 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:33:42.642460 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:33:42.642460 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: d0b828a3dca14f2283a16894364d6eef Jun 07 14:33:42.642460 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-TestVolumeBootPattern-1981564424-project Jun 07 14:33:42.642460 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:33:42.642460 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance 99bfe151-4396-4c86-9fb5-f26989972141 could not be found. Jun 07 14:33:42.642460 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': '99bfe151-4396-4c86-9fb5-f26989972141'} Jun 07 14:33:42.643457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:33:42.643457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:33:42.643457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:33:42.643457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:33:42.643457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:33:42.643457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:33:42.643457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:33:42.643457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:33:42.643457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:33:42.643457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:33:42.643457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99bfe151-4396-4c86-9fb5-f26989972141 could not be found. Jun 07 14:33:42.643457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:42.643457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:33:42.643457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:42.643457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:33:42.643457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:33:42.643457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:33:42.643457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:33:42.643457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:33:42.643457 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:33:42.644959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:33:42.644959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:33:42.644959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:33:42.644959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:33:42.644959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:33:42.644959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:33:42.644959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:33:42.644959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99bfe151-4396-4c86-9fb5-f26989972141 could not be found. Jun 07 14:33:42.644959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:42.644959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:33:42.644959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:42.644959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:33:42.644959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:33:42.644959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:33:42.644959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:33:42.644959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:33:42.644959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99bfe151-4396-4c86-9fb5-f26989972141 could not be found. Jun 07 14:33:42.644959 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:33:42.646459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-cc1e2852-187b-4429-9b70-80c735a6e2c2 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Returning 404 to user: Instance 99bfe151-4396-4c86-9fb5-f26989972141 could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:33:42.646459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-cc1e2852-187b-4429-9b70-80c735a6e2c2 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141" status: 404 len: 111 microversion: 2.1 time: 0.030107 Jun 07 14:33:42.646459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 523/1007] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:33:42 2022] GET /compute/v2.1/servers/99bfe151-4396-4c86-9fb5-f26989972141 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:33:43.928300 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e9d6f852-6b95-4584-a398-e55956281ac0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] Calling method '.version_select at 0x7ff3840a4ee0>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:43.950681 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e9d6f852-6b95-4584-a398-e55956281ac0 tempest-TestVolumeBootPattern-1981564424 tempest-TestVolumeBootPattern-1981564424-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-234910173" status: 202 len: 0 microversion: 2.1 time: 0.026220 Jun 07 14:33:43.951188 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 485/1008] 10.222.0.81 () {58 vars in 1259 bytes} [Tue Jun 7 14:33:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-234910173 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:34:01.141322 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-0388b195-23a1-41a0-ade8-8136833c11f7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:34:01.141840 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-0388b195-23a1-41a0-ade8-8136833c11f7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:34:01.143922 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:34:01.144589 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=58 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:34:01.150821 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0388b195-23a1-41a0-ade8-8136833c11f7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:01.151310 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0388b195-23a1-41a0-ade8-8136833c11f7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:01.152086 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0388b195-23a1-41a0-ade8-8136833c11f7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:01.152527 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0388b195-23a1-41a0-ade8-8136833c11f7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:01.177582 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-0388b195-23a1-41a0-ade8-8136833c11f7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38/ips" status: 200 len: 149 microversion: 2.1 time: 0.040778 Jun 07 14:34:01.178155 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 524/1009] 10.222.0.81 () {58 vars in 1247 bytes} [Tue Jun 7 14:34:01 2022] GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:34:02.519190 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:34:02.519964 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:34:02.524282 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-2c450e61-86a5-484d-94c6-8d92ecfb7836 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cf10caf-febf-42c4-ae06-3bd8a274ec54"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:34:02.525331 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-2c450e61-86a5-484d-94c6-8d92ecfb7836 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:34:02.537816 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2c450e61-86a5-484d-94c6-8d92ecfb7836 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:02.538271 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2c450e61-86a5-484d-94c6-8d92ecfb7836 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:02.539042 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2c450e61-86a5-484d-94c6-8d92ecfb7836 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:02.539524 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-2c450e61-86a5-484d-94c6-8d92ecfb7836 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:02.769414 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-2c450e61-86a5-484d-94c6-8d92ecfb7836 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "POST /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251578 Jun 07 14:34:02.770045 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 486/1010] 10.222.0.81 () {60 vars in 1322 bytes} [Tue Jun 7 14:34:02 2022] POST /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:34:09.203690 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-e32c3eb8-5430-4061-8328-237f3cc687d1 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Action: 'create', calling method: .version_select at 0x7ff3885eb160>, body: {"keypair": {"name": "tempest-keypair-1122054230", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoeBFKkWTg+p+MB2X3Tgklz1hwpJuXfa1YaKI3o9H7eG34uomPXt74juc/jVX+V5YXyku2fxx810FBbvnKNymN1FdSoI1sqp+Gb+1nAKZ5a1az/y/Pps3i7YtHKuwVMSA=="}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:34:09.218613 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-e32c3eb8-5430-4061-8328-237f3cc687d1 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Getting quotas for project a68951caf41c425cb3e1335e30d52a3c. Resources: {'key_pairs'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:34:09.222395 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-e32c3eb8-5430-4061-8328-237f3cc687d1 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Getting quotas for user a52df1ab67cb42b69f333adede204a61 and project a68951caf41c425cb3e1335e30d52a3c. Resources: {'key_pairs'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:34:09.245384 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-e32c3eb8-5430-4061-8328-237f3cc687d1 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045879 Jun 07 14:34:09.245990 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 525/1011] 10.222.0.81 () {60 vars in 1158 bytes} [Tue Jun 7 14:34:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:34:10.538025 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-b63b7260-5fdc-4312-918e-c77910deb5c7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-882538013", "imageRef": "2864004b-970a-480b-8453-14794f9ccca2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "33f78b17-9d5e-40c8-a0e8-fff86f3c9b61"}], "security_groups": [{"name": "tempest-securitygroup--438194789"}], "key_name": "tempest-keypair-1122054230", "user_data": "}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:34:10.638247 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.network.neutron [None req-b63b7260-5fdc-4312-918e-c77910deb5c7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] validate_networks() for [('33f78b17-9d5e-40c8-a0e8-fff86f3c9b61', None, None, None, None, None)] {{(pid=117564) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:34:11.110704 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-b63b7260-5fdc-4312-918e-c77910deb5c7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Flavor limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:34:11.111131 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-b63b7260-5fdc-4312-918e-c77910deb5c7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Image limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:34:11.111643 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-b63b7260-5fdc-4312-918e-c77910deb5c7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Flavor pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:34:11.112057 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-b63b7260-5fdc-4312-918e-c77910deb5c7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Image pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:34:11.112476 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-b63b7260-5fdc-4312-918e-c77910deb5c7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:34:11.121209 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b63b7260-5fdc-4312-918e-c77910deb5c7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:11.121661 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b63b7260-5fdc-4312-918e-c77910deb5c7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:11.122456 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b63b7260-5fdc-4312-918e-c77910deb5c7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:11.122916 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-b63b7260-5fdc-4312-918e-c77910deb5c7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:11.139971 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-b63b7260-5fdc-4312-918e-c77910deb5c7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Getting quotas for project a68951caf41c425cb3e1335e30d52a3c. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:34:11.151183 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-b63b7260-5fdc-4312-918e-c77910deb5c7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Getting quotas for user a52df1ab67cb42b69f333adede204a61 and project a68951caf41c425cb3e1335e30d52a3c. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:34:11.163086 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b63b7260-5fdc-4312-918e-c77910deb5c7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Going to run 1 instances... {{(pid=117564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:34:11.165578 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-b63b7260-5fdc-4312-918e-c77910deb5c7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 6a645b39-ab55-488a-b7a6-dd126b817efb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2864004b-970a-480b-8453-14794f9ccca2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:34:11.213390 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-b63b7260-5fdc-4312-918e-c77910deb5c7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.680495 Jun 07 14:34:11.214044 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 487/1012] 10.222.0.81 () {60 vars in 1146 bytes} [Tue Jun 7 14:34:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 14:34:11.224995 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3d2011ff-e459-4799-bc91-2cba8a0d3b96 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:34:11.225691 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-3d2011ff-e459-4799-bc91-2cba8a0d3b96 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 6a645b39-ab55-488a-b7a6-dd126b817efb] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:34:11.228096 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=4 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:34:11.288915 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-3d2011ff-e459-4799-bc91-2cba8a0d3b96 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:34:11.296325 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-3d2011ff-e459-4799-bc91-2cba8a0d3b96 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb" status: 200 len: 1241 microversion: 2.1 time: 0.075537 Jun 07 14:34:11.297174 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 526/1013] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:34:11 2022] GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:34:12.314917 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-128df652-eddc-431b-a4a4-591afc49f1cc tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:34:12.315592 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-128df652-eddc-431b-a4a4-591afc49f1cc tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 6a645b39-ab55-488a-b7a6-dd126b817efb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:34:12.322586 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-128df652-eddc-431b-a4a4-591afc49f1cc tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:12.323043 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-128df652-eddc-431b-a4a4-591afc49f1cc tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:12.323843 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-128df652-eddc-431b-a4a4-591afc49f1cc tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:12.324289 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-128df652-eddc-431b-a4a4-591afc49f1cc tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:12.396014 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-128df652-eddc-431b-a4a4-591afc49f1cc tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:34:12.404024 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-128df652-eddc-431b-a4a4-591afc49f1cc tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb" status: 200 len: 1299 microversion: 2.1 time: 0.094441 Jun 07 14:34:12.404803 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 488/1014] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:34:12 2022] GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:34:13.423142 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7c53c9ee-eee0-4dff-95cc-86f6de9caf51 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:34:13.423796 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-7c53c9ee-eee0-4dff-95cc-86f6de9caf51 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 6a645b39-ab55-488a-b7a6-dd126b817efb] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:34:13.430429 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7c53c9ee-eee0-4dff-95cc-86f6de9caf51 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:13.430877 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7c53c9ee-eee0-4dff-95cc-86f6de9caf51 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:13.431676 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7c53c9ee-eee0-4dff-95cc-86f6de9caf51 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:13.432129 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7c53c9ee-eee0-4dff-95cc-86f6de9caf51 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:13.469590 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-a7e9117d-698b-408e-a767-97bf090f786b req-706f6d9e-e42d-4657-9091-a86573ed8b03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a645b39-ab55-488a-b7a6-dd126b817efb", "tag": "5839daa0-815d-4c54-9649-425f396773f1"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:34:13.492154 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-a7e9117d-698b-408e-a767-97bf090f786b req-706f6d9e-e42d-4657-9091-a86573ed8b03 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:13.492814 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-a7e9117d-698b-408e-a767-97bf090f786b req-706f6d9e-e42d-4657-9091-a86573ed8b03 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:13.505587 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-a7e9117d-698b-408e-a767-97bf090f786b req-706f6d9e-e42d-4657-9091-a86573ed8b03 service nova] Creating event network-changed:5839daa0-815d-4c54-9649-425f396773f1 for instance 6a645b39-ab55-488a-b7a6-dd126b817efb on hv-cinder-83608 Jun 07 14:34:13.511007 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-a7e9117d-698b-408e-a767-97bf090f786b req-706f6d9e-e42d-4657-9091-a86573ed8b03 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051593 Jun 07 14:34:13.511750 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 489/1015] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:34:13.597103 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-7c53c9ee-eee0-4dff-95cc-86f6de9caf51 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:34:13.605066 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-7c53c9ee-eee0-4dff-95cc-86f6de9caf51 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb" status: 200 len: 1366 microversion: 2.1 time: 0.187335 Jun 07 14:34:13.606246 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 527/1016] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:34:13 2022] GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:34:14.622820 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-ab75313e-b91b-430e-b82e-273823596904 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:34:14.624115 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-ab75313e-b91b-430e-b82e-273823596904 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 6a645b39-ab55-488a-b7a6-dd126b817efb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:34:14.630377 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ab75313e-b91b-430e-b82e-273823596904 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:14.630866 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ab75313e-b91b-430e-b82e-273823596904 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:14.631640 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ab75313e-b91b-430e-b82e-273823596904 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:14.632086 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-ab75313e-b91b-430e-b82e-273823596904 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:14.760628 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-ab75313e-b91b-430e-b82e-273823596904 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:34:14.768901 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-ab75313e-b91b-430e-b82e-273823596904 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb" status: 200 len: 1366 microversion: 2.1 time: 0.150738 Jun 07 14:34:14.769489 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 490/1017] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:34:14 2022] GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:34:15.785776 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-694391a8-8fe6-4f72-9b8b-8fafe7ea01ec tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:34:15.786390 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-694391a8-8fe6-4f72-9b8b-8fafe7ea01ec tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 6a645b39-ab55-488a-b7a6-dd126b817efb] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:34:15.792937 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-694391a8-8fe6-4f72-9b8b-8fafe7ea01ec tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:15.793383 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-694391a8-8fe6-4f72-9b8b-8fafe7ea01ec tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:15.794129 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-694391a8-8fe6-4f72-9b8b-8fafe7ea01ec tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:15.794565 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-694391a8-8fe6-4f72-9b8b-8fafe7ea01ec tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:15.927755 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-694391a8-8fe6-4f72-9b8b-8fafe7ea01ec tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:34:15.935196 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-694391a8-8fe6-4f72-9b8b-8fafe7ea01ec tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb" status: 200 len: 1366 microversion: 2.1 time: 0.153285 Jun 07 14:34:15.935901 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 528/1018] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:34:15 2022] GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:34:16.952575 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-fd8d2acd-2549-4db6-a83f-531112aff982 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:34:16.953184 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-fd8d2acd-2549-4db6-a83f-531112aff982 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 6a645b39-ab55-488a-b7a6-dd126b817efb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:34:16.959697 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fd8d2acd-2549-4db6-a83f-531112aff982 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:16.960145 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fd8d2acd-2549-4db6-a83f-531112aff982 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:16.960913 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fd8d2acd-2549-4db6-a83f-531112aff982 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:16.961350 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fd8d2acd-2549-4db6-a83f-531112aff982 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:17.093864 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-fd8d2acd-2549-4db6-a83f-531112aff982 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:34:17.105033 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-fd8d2acd-2549-4db6-a83f-531112aff982 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb" status: 200 len: 1366 microversion: 2.1 time: 0.156813 Jun 07 14:34:17.105654 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 491/1019] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:34:16 2022] GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:34:17.962238 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-cc493825-de21-44a9-bdbf-8cf8d8b0f465 req-85bb2914-0469-4862-b020-ec77f86d253f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a645b39-ab55-488a-b7a6-dd126b817efb", "name": "network-vif-plugged", "status": "completed", "tag": "5839daa0-815d-4c54-9649-425f396773f1"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:34:17.971764 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-cc493825-de21-44a9-bdbf-8cf8d8b0f465 req-85bb2914-0469-4862-b020-ec77f86d253f service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:17.972205 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-cc493825-de21-44a9-bdbf-8cf8d8b0f465 req-85bb2914-0469-4862-b020-ec77f86d253f service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:17.983741 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-cc493825-de21-44a9-bdbf-8cf8d8b0f465 req-85bb2914-0469-4862-b020-ec77f86d253f service nova] Creating event network-vif-plugged:5839daa0-815d-4c54-9649-425f396773f1 for instance 6a645b39-ab55-488a-b7a6-dd126b817efb on hv-cinder-83608 Jun 07 14:34:17.988603 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-cc493825-de21-44a9-bdbf-8cf8d8b0f465 req-85bb2914-0469-4862-b020-ec77f86d253f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030108 Jun 07 14:34:17.989188 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 529/1020] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:34:18.121933 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-bb60619f-ed08-4047-8017-156a9cb4b9f7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:34:18.122657 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-bb60619f-ed08-4047-8017-156a9cb4b9f7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 6a645b39-ab55-488a-b7a6-dd126b817efb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:34:18.130159 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bb60619f-ed08-4047-8017-156a9cb4b9f7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:18.130697 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bb60619f-ed08-4047-8017-156a9cb4b9f7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:18.131586 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bb60619f-ed08-4047-8017-156a9cb4b9f7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:18.132094 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bb60619f-ed08-4047-8017-156a9cb4b9f7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:18.268988 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-bb60619f-ed08-4047-8017-156a9cb4b9f7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:34:18.276862 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-bb60619f-ed08-4047-8017-156a9cb4b9f7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb" status: 200 len: 1366 microversion: 2.1 time: 0.158852 Jun 07 14:34:18.277452 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 492/1021] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:34:18 2022] GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:34:19.297110 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-a96c3f77-57e9-4cef-b4c1-c29551335106 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:34:19.297808 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-a96c3f77-57e9-4cef-b4c1-c29551335106 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 6a645b39-ab55-488a-b7a6-dd126b817efb] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:34:19.305181 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a96c3f77-57e9-4cef-b4c1-c29551335106 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:19.305679 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a96c3f77-57e9-4cef-b4c1-c29551335106 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:19.306646 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a96c3f77-57e9-4cef-b4c1-c29551335106 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:19.307498 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-a96c3f77-57e9-4cef-b4c1-c29551335106 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:19.439665 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-a96c3f77-57e9-4cef-b4c1-c29551335106 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:34:19.447059 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-a96c3f77-57e9-4cef-b4c1-c29551335106 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb" status: 200 len: 1555 microversion: 2.1 time: 0.155185 Jun 07 14:34:19.447655 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 530/1022] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:34:19 2022] GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:34:19.463839 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e4e7a67f-b290-4af0-ac98-7dd5c5361143 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:34:19.464975 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e4e7a67f-b290-4af0-ac98-7dd5c5361143 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 6a645b39-ab55-488a-b7a6-dd126b817efb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:34:19.472479 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e4e7a67f-b290-4af0-ac98-7dd5c5361143 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:19.473189 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e4e7a67f-b290-4af0-ac98-7dd5c5361143 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:19.473950 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e4e7a67f-b290-4af0-ac98-7dd5c5361143 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:19.474383 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e4e7a67f-b290-4af0-ac98-7dd5c5361143 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:19.550539 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e4e7a67f-b290-4af0-ac98-7dd5c5361143 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090434 Jun 07 14:34:19.551134 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 493/1023] 10.222.0.81 () {58 vars in 1274 bytes} [Tue Jun 7 14:34:19 2022] GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:34:20.469023 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-22f54546-4b39-483c-aa4b-5bc8d64cc7b9 req-841a8d5f-ecab-41b3-872b-2a3f77cb70e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a645b39-ab55-488a-b7a6-dd126b817efb", "tag": "5839daa0-815d-4c54-9649-425f396773f1"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:34:20.477191 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-22f54546-4b39-483c-aa4b-5bc8d64cc7b9 req-841a8d5f-ecab-41b3-872b-2a3f77cb70e9 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:20.477629 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-22f54546-4b39-483c-aa4b-5bc8d64cc7b9 req-841a8d5f-ecab-41b3-872b-2a3f77cb70e9 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:20.488783 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-22f54546-4b39-483c-aa4b-5bc8d64cc7b9 req-841a8d5f-ecab-41b3-872b-2a3f77cb70e9 service nova] Creating event network-changed:5839daa0-815d-4c54-9649-425f396773f1 for instance 6a645b39-ab55-488a-b7a6-dd126b817efb on hv-cinder-83608 Jun 07 14:34:20.493895 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-22f54546-4b39-483c-aa4b-5bc8d64cc7b9 req-841a8d5f-ecab-41b3-872b-2a3f77cb70e9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029257 Jun 07 14:34:20.494859 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 531/1024] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:34:56.337194 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:34:56.337972 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=6 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:34:56.338689 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:34:56.339454 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:34:56.344005 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-a48cf63f-8546-4f79-be9d-f9056d4aefd4 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:34:56.344521 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-a48cf63f-8546-4f79-be9d-f9056d4aefd4 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 6a645b39-ab55-488a-b7a6-dd126b817efb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:34:56.352946 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a48cf63f-8546-4f79-be9d-f9056d4aefd4 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:56.353395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a48cf63f-8546-4f79-be9d-f9056d4aefd4 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:56.354156 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a48cf63f-8546-4f79-be9d-f9056d4aefd4 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:56.354592 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-a48cf63f-8546-4f79-be9d-f9056d4aefd4 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:56.379021 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-a48cf63f-8546-4f79-be9d-f9056d4aefd4 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb/ips" status: 200 len: 148 microversion: 2.1 time: 0.043197 Jun 07 14:34:56.379629 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 494/1025] 10.222.0.81 () {58 vars in 1247 bytes} [Tue Jun 7 14:34:56 2022] GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb/ips => generated 148 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:34:56.392126 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-c3513364-8022-4df6-ae4d-1ea40443969e tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cf10caf-febf-42c4-ae06-3bd8a274ec54"}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:34:56.393265 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-c3513364-8022-4df6-ae4d-1ea40443969e tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 6a645b39-ab55-488a-b7a6-dd126b817efb] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:34:56.395453 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=6 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:34:56.396154 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:34:56.396971 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=22 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:34:56.404512 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c3513364-8022-4df6-ae4d-1ea40443969e tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:56.404960 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c3513364-8022-4df6-ae4d-1ea40443969e tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:56.405722 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c3513364-8022-4df6-ae4d-1ea40443969e tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:56.406249 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-c3513364-8022-4df6-ae4d-1ea40443969e tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:56.486867 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-c3513364-8022-4df6-ae4d-1ea40443969e tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] HTTP exception thrown: Invalid volume: volume 2cf10caf-febf-42c4-ae06-3bd8a274ec54 is already attached to instances: 3e8589c3-e05b-4799-b7d3-badddcf67d38 Jun 07 14:34:56.488625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-c3513364-8022-4df6-ae4d-1ea40443969e tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Request method failure captured: Jun 07 14:34:56.488625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: POST /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb/os-volume_attachments HTTP/1.1 Jun 07 14:34:56.488625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:34:56.488625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:34:56.488625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:34:56.488625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 74 Jun 07 14:34:56.488625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:34:56.488625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:34:56.488625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:34:56.488625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:34:56.488625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin2GmsS231yllZtsbD6a6Z0roy55x891gPcc4OtdxXF4ia4D01PLG2cf5i38tn1r77Y2duhhtCS-saERLzBOKttnlwNxM2_Zani_N974cPUmMl1oV_SdbtUyM9d8ZGCIsSvKvKBnrobWnrqVnsEDW4J_SJ4y0aZXDb9uZb1f3C1l69PM Jun 07 14:34:56.488625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:34:56.488625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:34:56.488625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:34:56.488625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:34:56.488625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:34:56.488625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:34:56.488625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:34:56.488625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:34:56.488625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:34:56.488625 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:34:56.490186 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a68951caf41c425cb3e1335e30d52a3c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}] Jun 07 14:34:56.490186 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:34:56.490186 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:34:56.490186 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:34:56.490186 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:34:56.490186 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:34:56.490186 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:34:56.490186 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: a52df1ab67cb42b69f333adede204a61 Jun 07 14:34:56.490186 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:34:56.490186 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Jun 07 14:34:56.490186 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {"volumeAttachment": {"volumeId": "2cf10caf-febf-42c4-ae06-3bd8a274ec54"}} Jun 07 14:34:56.490186 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:34:56.491320 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Invalid volume: volume 2cf10caf-febf-42c4-ae06-3bd8a274ec54 is already attached to instances: 3e8589c3-e05b-4799-b7d3-badddcf67d38 Jun 07 14:34:56.491320 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'server_id': '6a645b39-ab55-488a-b7a6-dd126b817efb', 'body': {'volumeAttachment': {'volumeId': '2cf10caf-febf-42c4-ae06-3bd8a274ec54'}}} Jun 07 14:34:56.491320 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:34:56.491320 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:34:56.491320 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 14:34:56.491320 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 14:34:56.491320 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 14:34:56.491320 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 14:34:56.491320 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 07 14:34:56.491320 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 07 14:34:56.491320 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 07 14:34:56.491320 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 07 14:34:56.491320 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 07 14:34:56.491320 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 07 14:34:56.491320 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2cf10caf-febf-42c4-ae06-3bd8a274ec54 is already attached to instances: 3e8589c3-e05b-4799-b7d3-badddcf67d38 Jun 07 14:34:56.491320 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:34:56.491320 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:34:56.491320 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:34:56.491320 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:34:56.492845 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:34:56.492845 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:34:56.492845 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:34:56.492845 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:34:56.492845 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:34:56.492845 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:34:56.492845 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 14:34:56.492845 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 14:34:56.492845 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 14:34:56.492845 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 14:34:56.492845 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 14:34:56.492845 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 14:34:56.492845 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 07 14:34:56.492845 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 07 14:34:56.492845 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2cf10caf-febf-42c4-ae06-3bd8a274ec54 is already attached to instances: 3e8589c3-e05b-4799-b7d3-badddcf67d38 Jun 07 14:34:56.492845 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:34:56.492845 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:34:56.492845 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:34:56.492845 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:34:56.492845 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:34:56.494607 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:34:56.494607 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:34:56.494607 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:34:56.494607 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2cf10caf-febf-42c4-ae06-3bd8a274ec54 is already attached to instances: 3e8589c3-e05b-4799-b7d3-badddcf67d38 Jun 07 14:34:56.494607 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:34:56.494607 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-c3513364-8022-4df6-ae4d-1ea40443969e tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Returning 400 to user: Invalid volume: volume 2cf10caf-febf-42c4-ae06-3bd8a274ec54 is already attached to instances: 3e8589c3-e05b-4799-b7d3-badddcf67d38 {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:34:56.494607 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-c3513364-8022-4df6-ae4d-1ea40443969e tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "POST /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103206 Jun 07 14:34:56.494607 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 532/1026] 10.222.0.81 () {60 vars in 1322 bytes} [Tue Jun 7 14:34:56 2022] POST /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 14:34:56.498690 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-48c0783a-f795-4c2e-b223-dc93df4a6236 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:34:56.499610 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-48c0783a-f795-4c2e-b223-dc93df4a6236 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 6a645b39-ab55-488a-b7a6-dd126b817efb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:34:56.506207 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-48c0783a-f795-4c2e-b223-dc93df4a6236 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:56.506651 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-48c0783a-f795-4c2e-b223-dc93df4a6236 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:56.507487 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-48c0783a-f795-4c2e-b223-dc93df4a6236 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:56.507925 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-48c0783a-f795-4c2e-b223-dc93df4a6236 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:56.533923 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-48c0783a-f795-4c2e-b223-dc93df4a6236 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 6a645b39-ab55-488a-b7a6-dd126b817efb] Going to try to terminate instance {{(pid=117564) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:34:56.615287 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-48c0783a-f795-4c2e-b223-dc93df4a6236 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb" status: 204 len: 0 microversion: 2.1 time: 0.119904 Jun 07 14:34:56.616012 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 495/1027] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:34:56 2022] DELETE /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:34:56.624445 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-18a413d0-2ace-459f-9e83-fb5adbfe4a38 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:34:56.625643 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-18a413d0-2ace-459f-9e83-fb5adbfe4a38 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 6a645b39-ab55-488a-b7a6-dd126b817efb] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:34:56.632602 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-18a413d0-2ace-459f-9e83-fb5adbfe4a38 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:56.633059 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-18a413d0-2ace-459f-9e83-fb5adbfe4a38 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:56.633834 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-18a413d0-2ace-459f-9e83-fb5adbfe4a38 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:56.634276 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-18a413d0-2ace-459f-9e83-fb5adbfe4a38 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:56.765673 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-18a413d0-2ace-459f-9e83-fb5adbfe4a38 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:34:56.773162 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-18a413d0-2ace-459f-9e83-fb5adbfe4a38 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb" status: 200 len: 1679 microversion: 2.1 time: 0.152814 Jun 07 14:34:56.773732 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 533/1028] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:34:56 2022] GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:34:57.790990 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1fe53065-eb93-4bd0-92a1-3dc033ab8d1f tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:34:57.791721 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1fe53065-eb93-4bd0-92a1-3dc033ab8d1f tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 6a645b39-ab55-488a-b7a6-dd126b817efb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:34:57.798176 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1fe53065-eb93-4bd0-92a1-3dc033ab8d1f tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:57.798634 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1fe53065-eb93-4bd0-92a1-3dc033ab8d1f tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:57.799437 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1fe53065-eb93-4bd0-92a1-3dc033ab8d1f tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:57.799879 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1fe53065-eb93-4bd0-92a1-3dc033ab8d1f tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:57.929268 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-1fe53065-eb93-4bd0-92a1-3dc033ab8d1f tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:34:57.936727 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1fe53065-eb93-4bd0-92a1-3dc033ab8d1f tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb" status: 200 len: 1679 microversion: 2.1 time: 0.149982 Jun 07 14:34:57.937804 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 496/1029] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:34:57 2022] GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:34:58.843388 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-c1924279-6bb3-4141-940e-6158efd70a5b req-b340f68e-1409-434b-98e6-e479bb8df018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a645b39-ab55-488a-b7a6-dd126b817efb", "name": "network-vif-deleted", "tag": "5839daa0-815d-4c54-9649-425f396773f1"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:34:58.854213 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-c1924279-6bb3-4141-940e-6158efd70a5b req-b340f68e-1409-434b-98e6-e479bb8df018 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:58.854735 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-c1924279-6bb3-4141-940e-6158efd70a5b req-b340f68e-1409-434b-98e6-e479bb8df018 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:58.869100 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-c1924279-6bb3-4141-940e-6158efd70a5b req-b340f68e-1409-434b-98e6-e479bb8df018 service nova] Creating event network-vif-deleted:5839daa0-815d-4c54-9649-425f396773f1 for instance 6a645b39-ab55-488a-b7a6-dd126b817efb on hv-cinder-83608 Jun 07 14:34:58.874432 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-c1924279-6bb3-4141-940e-6158efd70a5b req-b340f68e-1409-434b-98e6-e479bb8df018 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034806 Jun 07 14:34:58.876157 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 534/1030] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:34:58.954347 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7320c678-c6dd-492a-8ea0-05c0d0de8414 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:34:58.955738 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7320c678-c6dd-492a-8ea0-05c0d0de8414 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 6a645b39-ab55-488a-b7a6-dd126b817efb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:34:58.962615 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7320c678-c6dd-492a-8ea0-05c0d0de8414 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:58.963393 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7320c678-c6dd-492a-8ea0-05c0d0de8414 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:58.964627 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7320c678-c6dd-492a-8ea0-05c0d0de8414 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:58.965241 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7320c678-c6dd-492a-8ea0-05c0d0de8414 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:59.000666 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7320c678-c6dd-492a-8ea0-05c0d0de8414 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:34:59.001352 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7320c678-c6dd-492a-8ea0-05c0d0de8414 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:34:59.002005 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-7320c678-c6dd-492a-8ea0-05c0d0de8414 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lazy-loading 'fault' on Instance uuid 6a645b39-ab55-488a-b7a6-dd126b817efb {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:34:59.047866 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-7320c678-c6dd-492a-8ea0-05c0d0de8414 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:34:59.056046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7320c678-c6dd-492a-8ea0-05c0d0de8414 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb" status: 200 len: 1331 microversion: 2.1 time: 0.105900 Jun 07 14:34:59.056631 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 497/1031] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:34:58 2022] GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:35:00.074507 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-73d960bc-61a4-4f8c-bb1c-3eba4b4d0683 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:35:00.075212 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-73d960bc-61a4-4f8c-bb1c-3eba4b4d0683 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 6a645b39-ab55-488a-b7a6-dd126b817efb] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:35:00.081461 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-73d960bc-61a4-4f8c-bb1c-3eba4b4d0683 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:00.081910 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-73d960bc-61a4-4f8c-bb1c-3eba4b4d0683 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:00.082669 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-73d960bc-61a4-4f8c-bb1c-3eba4b4d0683 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:00.083107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-73d960bc-61a4-4f8c-bb1c-3eba4b4d0683 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:00.096714 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-73d960bc-61a4-4f8c-bb1c-3eba4b4d0683 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] HTTP exception thrown: Instance 6a645b39-ab55-488a-b7a6-dd126b817efb could not be found. Jun 07 14:35:00.098243 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-73d960bc-61a4-4f8c-bb1c-3eba4b4d0683 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Request method failure captured: Jun 07 14:35:00.098243 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb HTTP/1.1 Jun 07 14:35:00.098243 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:35:00.098243 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:35:00.098243 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:35:00.098243 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:35:00.098243 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:35:00.098243 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:35:00.098243 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:35:00.098243 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:35:00.098243 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin2GmsS231yllZtsbD6a6Z0roy55x891gPcc4OtdxXF4ia4D01PLG2cf5i38tn1r77Y2duhhtCS-saERLzBOKttnlwNxM2_Zani_N974cPUmMl1oV_SdbtUyM9d8ZGCIsSvKvKBnrobWnrqVnsEDW4J_SJ4y0aZXDb9uZb1f3C1l69PM Jun 07 14:35:00.098243 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:35:00.098243 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:35:00.098243 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:35:00.098243 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:35:00.098243 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:35:00.098243 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:35:00.098243 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:35:00.098243 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:35:00.098243 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:35:00.098243 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:35:00.099991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a68951caf41c425cb3e1335e30d52a3c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}] Jun 07 14:35:00.099991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:35:00.099991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:35:00.099991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:35:00.099991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:35:00.099991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:35:00.099991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:35:00.099991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: a52df1ab67cb42b69f333adede204a61 Jun 07 14:35:00.099991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:35:00.099991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:35:00.099991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance 6a645b39-ab55-488a-b7a6-dd126b817efb could not be found. Jun 07 14:35:00.099991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': '6a645b39-ab55-488a-b7a6-dd126b817efb'} Jun 07 14:35:00.100819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:35:00.100819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:35:00.100819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:35:00.100819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:35:00.100819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:35:00.100819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:35:00.100819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:35:00.100819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:35:00.100819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:35:00.100819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:35:00.100819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a645b39-ab55-488a-b7a6-dd126b817efb could not be found. Jun 07 14:35:00.100819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:35:00.100819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:35:00.100819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:35:00.100819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:35:00.100819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:35:00.100819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:35:00.100819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:35:00.100819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:35:00.100819 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:35:00.102401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:35:00.102401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:35:00.102401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:35:00.102401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:35:00.102401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:35:00.102401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:35:00.102401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:35:00.102401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a645b39-ab55-488a-b7a6-dd126b817efb could not be found. Jun 07 14:35:00.102401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:35:00.102401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:35:00.102401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:35:00.102401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:35:00.102401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:35:00.102401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:35:00.102401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:35:00.102401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:35:00.102401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a645b39-ab55-488a-b7a6-dd126b817efb could not be found. Jun 07 14:35:00.102401 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:35:00.104014 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-73d960bc-61a4-4f8c-bb1c-3eba4b4d0683 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Returning 404 to user: Instance 6a645b39-ab55-488a-b7a6-dd126b817efb could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:35:00.104014 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-73d960bc-61a4-4f8c-bb1c-3eba4b4d0683 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb" status: 404 len: 111 microversion: 2.1 time: 0.030208 Jun 07 14:35:00.104014 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 535/1032] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:35:00 2022] GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:35:00.108608 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-206540eb-6807-4dd8-8bf6-844b08aab333 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '.version_select at 0x7ff3840a4820>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:35:00.126498 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-206540eb-6807-4dd8-8bf6-844b08aab333 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1122054230" status: 202 len: 0 microversion: 2.1 time: 0.021647 Jun 07 14:35:00.127052 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 498/1033] 10.222.0.81 () {58 vars in 1220 bytes} [Tue Jun 7 14:35:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1122054230 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:35:00.764978 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-1ebc699e-37f6-4c03-84a5-d518d5a04772 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:35:00.765982 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-1ebc699e-37f6-4c03-84a5-d518d5a04772 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:35:00.772066 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1ebc699e-37f6-4c03-84a5-d518d5a04772 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:00.772518 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1ebc699e-37f6-4c03-84a5-d518d5a04772 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:00.773276 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1ebc699e-37f6-4c03-84a5-d518d5a04772 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:00.773715 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1ebc699e-37f6-4c03-84a5-d518d5a04772 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:00.852278 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.objects.instance [None req-1ebc699e-37f6-4c03-84a5-d518d5a04772 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lazy-loading 'services' on Instance uuid 3e8589c3-e05b-4799-b7d3-badddcf67d38 {{(pid=117565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:35:00.922018 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-1ebc699e-37f6-4c03-84a5-d518d5a04772 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "DELETE /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38/os-volume_attachments/2cf10caf-febf-42c4-ae06-3bd8a274ec54" status: 202 len: 0 microversion: 2.1 time: 0.160677 Jun 07 14:35:00.922754 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 536/1034] 10.222.0.81 () {58 vars in 1415 bytes} [Tue Jun 7 14:35:00 2022] DELETE /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38/os-volume_attachments/2cf10caf-febf-42c4-ae06-3bd8a274ec54 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:35:00.931147 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-cf39685d-e0ba-4c17-9e50-30f96b8e481b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:35:00.932163 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-cf39685d-e0ba-4c17-9e50-30f96b8e481b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:35:00.939397 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cf39685d-e0ba-4c17-9e50-30f96b8e481b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:00.939951 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cf39685d-e0ba-4c17-9e50-30f96b8e481b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:00.940710 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cf39685d-e0ba-4c17-9e50-30f96b8e481b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:00.941150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-cf39685d-e0ba-4c17-9e50-30f96b8e481b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:00.971691 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-cf39685d-e0ba-4c17-9e50-30f96b8e481b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044480 Jun 07 14:35:00.972165 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 499/1035] 10.222.0.81 () {58 vars in 1301 bytes} [Tue Jun 7 14:35:00 2022] GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:35:01.984983 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-10292246-26a1-4ae1-a74c-982ccd88e521 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:35:01.985981 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-10292246-26a1-4ae1-a74c-982ccd88e521 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:35:01.992192 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-10292246-26a1-4ae1-a74c-982ccd88e521 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:01.992651 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-10292246-26a1-4ae1-a74c-982ccd88e521 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:01.993412 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-10292246-26a1-4ae1-a74c-982ccd88e521 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:01.993849 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-10292246-26a1-4ae1-a74c-982ccd88e521 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:02.022697 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-10292246-26a1-4ae1-a74c-982ccd88e521 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043005 Jun 07 14:35:02.023349 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 537/1036] 10.222.0.81 () {58 vars in 1301 bytes} [Tue Jun 7 14:35:01 2022] GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 14:35:02.263042 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-606b9ae7-e2fd-4b6f-9bc5-9119812c69f3 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:35:02.263580 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-606b9ae7-e2fd-4b6f-9bc5-9119812c69f3 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:35:02.270258 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-606b9ae7-e2fd-4b6f-9bc5-9119812c69f3 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:02.270713 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-606b9ae7-e2fd-4b6f-9bc5-9119812c69f3 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:02.271515 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-606b9ae7-e2fd-4b6f-9bc5-9119812c69f3 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:02.271959 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-606b9ae7-e2fd-4b6f-9bc5-9119812c69f3 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:02.301054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-606b9ae7-e2fd-4b6f-9bc5-9119812c69f3 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] Going to try to terminate instance {{(pid=117564) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:35:02.374667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-606b9ae7-e2fd-4b6f-9bc5-9119812c69f3 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "DELETE /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38" status: 204 len: 0 microversion: 2.1 time: 0.115210 Jun 07 14:35:02.375323 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 500/1037] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:35:02 2022] DELETE /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:35:02.384297 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-b68b6001-ed46-4ce8-8b65-b33e8e73ffcb tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:35:02.384915 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-b68b6001-ed46-4ce8-8b65-b33e8e73ffcb tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:35:02.391482 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b68b6001-ed46-4ce8-8b65-b33e8e73ffcb tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:02.391934 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b68b6001-ed46-4ce8-8b65-b33e8e73ffcb tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:02.392701 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b68b6001-ed46-4ce8-8b65-b33e8e73ffcb tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:02.393140 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-b68b6001-ed46-4ce8-8b65-b33e8e73ffcb tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:02.521675 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-b68b6001-ed46-4ce8-8b65-b33e8e73ffcb tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:35:02.529052 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-b68b6001-ed46-4ce8-8b65-b33e8e73ffcb tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38" status: 200 len: 1681 microversion: 2.1 time: 0.148688 Jun 07 14:35:02.529619 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 538/1038] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:35:02 2022] GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:35:03.547505 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c323181b-c70d-4eff-b380-22451c1872b1 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:35:03.548444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-c323181b-c70d-4eff-b380-22451c1872b1 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:35:03.554980 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c323181b-c70d-4eff-b380-22451c1872b1 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:03.555478 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c323181b-c70d-4eff-b380-22451c1872b1 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:03.556231 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c323181b-c70d-4eff-b380-22451c1872b1 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:03.556664 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-c323181b-c70d-4eff-b380-22451c1872b1 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:03.688483 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-c323181b-c70d-4eff-b380-22451c1872b1 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:35:03.696068 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c323181b-c70d-4eff-b380-22451c1872b1 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38" status: 200 len: 1681 microversion: 2.1 time: 0.153340 Jun 07 14:35:03.696637 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 501/1039] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:35:03 2022] GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:35:04.712663 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-cc5a37f0-786b-4c7e-b3d4-305476b11e6e tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:35:04.713292 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-cc5a37f0-786b-4c7e-b3d4-305476b11e6e tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:35:04.720647 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cc5a37f0-786b-4c7e-b3d4-305476b11e6e tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:04.721104 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cc5a37f0-786b-4c7e-b3d4-305476b11e6e tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:04.721877 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cc5a37f0-786b-4c7e-b3d4-305476b11e6e tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:04.722313 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-cc5a37f0-786b-4c7e-b3d4-305476b11e6e tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:04.856699 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-cc5a37f0-786b-4c7e-b3d4-305476b11e6e tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:35:04.865229 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-cc5a37f0-786b-4c7e-b3d4-305476b11e6e tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38" status: 200 len: 1681 microversion: 2.1 time: 0.156485 Jun 07 14:35:04.865899 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 539/1040] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:35:04 2022] GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:35:05.370318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-abebb69d-8dd1-47df-9eef-f20cea2073c1 req-0dc5c37d-57b6-4474-8b8d-73a8de31d597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e8589c3-e05b-4799-b7d3-badddcf67d38", "name": "network-vif-deleted", "tag": "efe6ad85-77cb-475a-8c69-a4e6f8c4bd6f"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:35:05.380123 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-abebb69d-8dd1-47df-9eef-f20cea2073c1 req-0dc5c37d-57b6-4474-8b8d-73a8de31d597 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:05.381006 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-abebb69d-8dd1-47df-9eef-f20cea2073c1 req-0dc5c37d-57b6-4474-8b8d-73a8de31d597 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:05.393583 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-abebb69d-8dd1-47df-9eef-f20cea2073c1 req-0dc5c37d-57b6-4474-8b8d-73a8de31d597 service nova] Creating event network-vif-deleted:efe6ad85-77cb-475a-8c69-a4e6f8c4bd6f for instance 3e8589c3-e05b-4799-b7d3-badddcf67d38 on hv-cinder-83608 Jun 07 14:35:05.398703 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-abebb69d-8dd1-47df-9eef-f20cea2073c1 req-0dc5c37d-57b6-4474-8b8d-73a8de31d597 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032251 Jun 07 14:35:05.399273 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 502/1041] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:35:05.881932 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d6586224-ff4d-415f-b78b-00cd6206d846 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:35:05.882550 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-d6586224-ff4d-415f-b78b-00cd6206d846 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:35:05.889097 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d6586224-ff4d-415f-b78b-00cd6206d846 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:05.889548 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d6586224-ff4d-415f-b78b-00cd6206d846 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:05.890313 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d6586224-ff4d-415f-b78b-00cd6206d846 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:05.891324 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d6586224-ff4d-415f-b78b-00cd6206d846 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:05.904809 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-d6586224-ff4d-415f-b78b-00cd6206d846 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] HTTP exception thrown: Instance 3e8589c3-e05b-4799-b7d3-badddcf67d38 could not be found. Jun 07 14:35:05.907203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d6586224-ff4d-415f-b78b-00cd6206d846 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Request method failure captured: Jun 07 14:35:05.907203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38 HTTP/1.1 Jun 07 14:35:05.907203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:35:05.907203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:35:05.907203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:35:05.907203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:35:05.907203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:35:05.907203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:35:05.907203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:35:05.907203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:35:05.907203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin2GmsS231yllZtsbD6a6Z0roy55x891gPcc4OtdxXF4ia4D01PLG2cf5i38tn1r77Y2duhhtCS-saERLzBOKttnlwNxM2_Zani_N974cPUmMl1oV_SdbtUyM9d8ZGCIsSvKvKBnrobWnrqVnsEDW4J_SJ4y0aZXDb9uZb1f3C1l69PM Jun 07 14:35:05.907203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:35:05.907203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:35:05.907203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:35:05.907203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:35:05.907203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:35:05.907203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:35:05.907203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:35:05.907203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:35:05.907203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:35:05.907203 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:35:05.908852 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a68951caf41c425cb3e1335e30d52a3c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}] Jun 07 14:35:05.908852 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:35:05.908852 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:35:05.908852 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:35:05.908852 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:35:05.908852 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:35:05.908852 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:35:05.908852 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: a52df1ab67cb42b69f333adede204a61 Jun 07 14:35:05.908852 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:35:05.908852 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:35:05.908852 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance 3e8589c3-e05b-4799-b7d3-badddcf67d38 could not be found. Jun 07 14:35:05.908852 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': '3e8589c3-e05b-4799-b7d3-badddcf67d38'} Jun 07 14:35:05.909991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:35:05.909991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:35:05.909991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:35:05.909991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:35:05.909991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:35:05.909991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:35:05.909991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:35:05.909991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:35:05.909991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:35:05.909991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:35:05.909991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e8589c3-e05b-4799-b7d3-badddcf67d38 could not be found. Jun 07 14:35:05.909991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:35:05.909991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:35:05.909991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:35:05.909991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:35:05.909991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:35:05.909991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:35:05.909991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:35:05.909991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:35:05.909991 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:35:05.911404 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:35:05.911404 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:35:05.911404 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:35:05.911404 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:35:05.911404 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:35:05.911404 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:35:05.911404 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:35:05.911404 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e8589c3-e05b-4799-b7d3-badddcf67d38 could not be found. Jun 07 14:35:05.911404 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:35:05.911404 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:35:05.911404 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:35:05.911404 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:35:05.911404 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:35:05.911404 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:35:05.911404 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:35:05.911404 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:35:05.911404 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e8589c3-e05b-4799-b7d3-badddcf67d38 could not be found. Jun 07 14:35:05.911404 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:35:05.913138 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d6586224-ff4d-415f-b78b-00cd6206d846 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Returning 404 to user: Instance 3e8589c3-e05b-4799-b7d3-badddcf67d38 could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:35:05.913138 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-d6586224-ff4d-415f-b78b-00cd6206d846 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38" status: 404 len: 111 microversion: 2.1 time: 0.030678 Jun 07 14:35:05.913138 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 540/1042] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:35:05 2022] GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:35:05.918848 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-d8dcd8dc-1420-473e-af52-3d55cc6951b8 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '.version_select at 0x7ff3852f0790>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:35:05.935799 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-d8dcd8dc-1420-473e-af52-3d55cc6951b8 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1614943308" status: 202 len: 0 microversion: 2.1 time: 0.021387 Jun 07 14:35:05.936368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 503/1043] 10.222.0.81 () {58 vars in 1220 bytes} [Tue Jun 7 14:35:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1614943308 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:35:06.601459 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-65608e56-9915-4df1-abfe-7dad6f451e3a tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Action: 'create', calling method: .version_select at 0x7ff3886678b0>, body: {"keypair": {"name": "tempest-keypair-1045380591", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO52YENYwopwhDTOmWkC1111gPz+JObX3/Dwelc9thuoN2y7t5THJH3G8/IqWw3VVOyYNQjIKogSPShXv/y+nm1ud1ApcK2A+J8fRg0n7PhTkkjszwwiwqoR3c47op+BTg=="}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:35:06.615922 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-65608e56-9915-4df1-abfe-7dad6f451e3a tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Getting quotas for project a68951caf41c425cb3e1335e30d52a3c. Resources: {'key_pairs'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:35:06.619659 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-65608e56-9915-4df1-abfe-7dad6f451e3a tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Getting quotas for user a52df1ab67cb42b69f333adede204a61 and project a68951caf41c425cb3e1335e30d52a3c. Resources: {'key_pairs'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:35:06.641187 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-65608e56-9915-4df1-abfe-7dad6f451e3a tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043758 Jun 07 14:35:06.641785 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 541/1044] 10.222.0.81 () {60 vars in 1158 bytes} [Tue Jun 7 14:35:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:35:07.874703 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-4cb0d384-e3e3-4580-ad00-b076666b1781 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1164387279", "imageRef": "2864004b-970a-480b-8453-14794f9ccca2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "33f78b17-9d5e-40c8-a0e8-fff86f3c9b61"}], "security_groups": [{"name": "tempest-securitygroup--685967016"}], "key_name": "tempest-keypair-1045380591", "user_data": "}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:35:07.975333 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.network.neutron [None req-4cb0d384-e3e3-4580-ad00-b076666b1781 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] validate_networks() for [('33f78b17-9d5e-40c8-a0e8-fff86f3c9b61', None, None, None, None, None)] {{(pid=117564) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:35:08.337311 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-4cb0d384-e3e3-4580-ad00-b076666b1781 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Flavor limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:35:08.337743 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-4cb0d384-e3e3-4580-ad00-b076666b1781 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Image limits 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:35:08.338250 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-4cb0d384-e3e3-4580-ad00-b076666b1781 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Flavor pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:35:08.338662 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-4cb0d384-e3e3-4580-ad00-b076666b1781 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Image pref 0:0:0 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:35:08.339077 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.virt.hardware [None req-4cb0d384-e3e3-4580-ad00-b076666b1781 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:35:08.348468 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4cb0d384-e3e3-4580-ad00-b076666b1781 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:08.349174 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4cb0d384-e3e3-4580-ad00-b076666b1781 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:08.349974 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4cb0d384-e3e3-4580-ad00-b076666b1781 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:08.350412 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-4cb0d384-e3e3-4580-ad00-b076666b1781 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:08.367306 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-4cb0d384-e3e3-4580-ad00-b076666b1781 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Getting quotas for project a68951caf41c425cb3e1335e30d52a3c. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:35:08.371189 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-4cb0d384-e3e3-4580-ad00-b076666b1781 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Getting quotas for user a52df1ab67cb42b69f333adede204a61 and project a68951caf41c425cb3e1335e30d52a3c. Resources: {'ram', 'cores', 'instances'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:35:08.382806 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-4cb0d384-e3e3-4580-ad00-b076666b1781 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Going to run 1 instances... {{(pid=117564) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:35:08.385222 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-4cb0d384-e3e3-4580-ad00-b076666b1781 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2864004b-970a-480b-8453-14794f9ccca2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:35:08.430607 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-4cb0d384-e3e3-4580-ad00-b076666b1781 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.560760 Jun 07 14:35:08.431286 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 504/1045] 10.222.0.81 () {60 vars in 1146 bytes} [Tue Jun 7 14:35:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:35:08.442259 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-dc70fd44-19d8-407e-87a6-a7f0a8ee0ee3 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:35:08.442902 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-dc70fd44-19d8-407e-87a6-a7f0a8ee0ee3 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:35:08.497496 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-dc70fd44-19d8-407e-87a6-a7f0a8ee0ee3 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:35:08.504852 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-dc70fd44-19d8-407e-87a6-a7f0a8ee0ee3 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f" status: 200 len: 1242 microversion: 2.1 time: 0.067488 Jun 07 14:35:08.505421 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 542/1046] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:35:08 2022] GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:35:09.521986 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0c5de931-c7f5-4135-9f1f-027c771722f6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:35:09.522609 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0c5de931-c7f5-4135-9f1f-027c771722f6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:35:09.529521 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0c5de931-c7f5-4135-9f1f-027c771722f6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:09.529962 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0c5de931-c7f5-4135-9f1f-027c771722f6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:09.530717 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0c5de931-c7f5-4135-9f1f-027c771722f6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:09.531242 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0c5de931-c7f5-4135-9f1f-027c771722f6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:09.594742 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-0c5de931-c7f5-4135-9f1f-027c771722f6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:35:09.602606 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0c5de931-c7f5-4135-9f1f-027c771722f6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f" status: 200 len: 1300 microversion: 2.1 time: 0.084822 Jun 07 14:35:09.603394 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 505/1047] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:35:09 2022] GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:35:10.620303 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ebb773c3-bdaa-4231-b3ba-34069fd77e97 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:35:10.621104 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ebb773c3-bdaa-4231-b3ba-34069fd77e97 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:35:10.630157 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ebb773c3-bdaa-4231-b3ba-34069fd77e97 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:10.630751 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ebb773c3-bdaa-4231-b3ba-34069fd77e97 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:10.631733 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ebb773c3-bdaa-4231-b3ba-34069fd77e97 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:10.632240 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ebb773c3-bdaa-4231-b3ba-34069fd77e97 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:10.781838 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-ed6a9e52-12d4-4343-bb49-0e6e97fe1aa2 req-020cc0d8-ffda-47b4-82c7-3beec465213a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f", "tag": "c3e460f4-54c0-49e3-8447-65d616ce7aa7"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:35:10.784637 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-ebb773c3-bdaa-4231-b3ba-34069fd77e97 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:35:10.800582 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ebb773c3-bdaa-4231-b3ba-34069fd77e97 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f" status: 200 len: 1367 microversion: 2.1 time: 0.184227 Jun 07 14:35:10.801394 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 543/1048] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:35:10 2022] GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:35:10.806035 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-ed6a9e52-12d4-4343-bb49-0e6e97fe1aa2 req-020cc0d8-ffda-47b4-82c7-3beec465213a service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:10.806680 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-ed6a9e52-12d4-4343-bb49-0e6e97fe1aa2 req-020cc0d8-ffda-47b4-82c7-3beec465213a service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:10.820148 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-ed6a9e52-12d4-4343-bb49-0e6e97fe1aa2 req-020cc0d8-ffda-47b4-82c7-3beec465213a service nova] Creating event network-changed:c3e460f4-54c0-49e3-8447-65d616ce7aa7 for instance e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f on hv-cinder-83608 Jun 07 14:35:10.825298 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-ed6a9e52-12d4-4343-bb49-0e6e97fe1aa2 req-020cc0d8-ffda-47b4-82c7-3beec465213a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049683 Jun 07 14:35:10.825979 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 506/1049] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:35:11.818336 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-1cfd25b8-2dbe-49c7-85fa-5bb4881f34c2 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:35:11.818951 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-1cfd25b8-2dbe-49c7-85fa-5bb4881f34c2 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:35:11.825584 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1cfd25b8-2dbe-49c7-85fa-5bb4881f34c2 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:11.826024 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1cfd25b8-2dbe-49c7-85fa-5bb4881f34c2 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:11.826779 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1cfd25b8-2dbe-49c7-85fa-5bb4881f34c2 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:11.827209 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-1cfd25b8-2dbe-49c7-85fa-5bb4881f34c2 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:11.962475 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-1cfd25b8-2dbe-49c7-85fa-5bb4881f34c2 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:35:11.970059 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-1cfd25b8-2dbe-49c7-85fa-5bb4881f34c2 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f" status: 200 len: 1367 microversion: 2.1 time: 0.155526 Jun 07 14:35:11.970632 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 544/1050] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:35:11 2022] GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:35:12.987891 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-6846a1a0-13d4-45b7-858b-4a0c43b435f4 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:35:12.988587 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-6846a1a0-13d4-45b7-858b-4a0c43b435f4 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:35:12.994828 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6846a1a0-13d4-45b7-858b-4a0c43b435f4 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:12.995240 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6846a1a0-13d4-45b7-858b-4a0c43b435f4 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:12.996008 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6846a1a0-13d4-45b7-858b-4a0c43b435f4 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:12.996441 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-6846a1a0-13d4-45b7-858b-4a0c43b435f4 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:13.131081 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-6846a1a0-13d4-45b7-858b-4a0c43b435f4 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:35:13.138591 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-6846a1a0-13d4-45b7-858b-4a0c43b435f4 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f" status: 200 len: 1367 microversion: 2.1 time: 0.155552 Jun 07 14:35:13.139167 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 507/1051] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:35:12 2022] GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:35:14.156175 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-4760cf0f-24f8-4d7d-a7f8-c6bb5c25f27a tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:35:14.156983 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-4760cf0f-24f8-4d7d-a7f8-c6bb5c25f27a tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:35:14.163733 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4760cf0f-24f8-4d7d-a7f8-c6bb5c25f27a tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:14.164207 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4760cf0f-24f8-4d7d-a7f8-c6bb5c25f27a tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:14.164941 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4760cf0f-24f8-4d7d-a7f8-c6bb5c25f27a tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:14.165377 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-4760cf0f-24f8-4d7d-a7f8-c6bb5c25f27a tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:14.569754 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-4760cf0f-24f8-4d7d-a7f8-c6bb5c25f27a tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:35:14.577063 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-4760cf0f-24f8-4d7d-a7f8-c6bb5c25f27a tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f" status: 200 len: 1367 microversion: 2.1 time: 0.424959 Jun 07 14:35:14.577917 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 545/1052] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:35:14 2022] GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f => generated 1367 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:35:15.594233 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7bde9520-b54e-422c-87bf-a5be90c1fc15 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:35:15.595626 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7bde9520-b54e-422c-87bf-a5be90c1fc15 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:35:15.602462 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7bde9520-b54e-422c-87bf-a5be90c1fc15 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:15.602912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7bde9520-b54e-422c-87bf-a5be90c1fc15 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:15.603712 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7bde9520-b54e-422c-87bf-a5be90c1fc15 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:15.604151 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7bde9520-b54e-422c-87bf-a5be90c1fc15 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:15.732728 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-7bde9520-b54e-422c-87bf-a5be90c1fc15 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:35:15.740397 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7bde9520-b54e-422c-87bf-a5be90c1fc15 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f" status: 200 len: 1367 microversion: 2.1 time: 0.150031 Jun 07 14:35:15.740971 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 508/1053] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:35:15 2022] GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:35:16.278299 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-a8bfe192-202a-4ff3-94be-ecfd644921e2 req-a9f487f8-eaf1-497e-9b41-9b1dc23eaef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f", "name": "network-vif-plugged", "status": "completed", "tag": "c3e460f4-54c0-49e3-8447-65d616ce7aa7"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:35:16.288411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-a8bfe192-202a-4ff3-94be-ecfd644921e2 req-a9f487f8-eaf1-497e-9b41-9b1dc23eaef5 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:16.288666 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-a8bfe192-202a-4ff3-94be-ecfd644921e2 req-a9f487f8-eaf1-497e-9b41-9b1dc23eaef5 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:16.302477 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-a8bfe192-202a-4ff3-94be-ecfd644921e2 req-a9f487f8-eaf1-497e-9b41-9b1dc23eaef5 service nova] Creating event network-vif-plugged:c3e460f4-54c0-49e3-8447-65d616ce7aa7 for instance e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f on hv-cinder-83608 Jun 07 14:35:16.307508 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-a8bfe192-202a-4ff3-94be-ecfd644921e2 req-a9f487f8-eaf1-497e-9b41-9b1dc23eaef5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032920 Jun 07 14:35:16.308339 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 546/1054] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:35:16.757625 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-566ddca7-8da5-4c64-8380-9331aefe77aa tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:35:16.758242 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-566ddca7-8da5-4c64-8380-9331aefe77aa tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:35:16.764291 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-566ddca7-8da5-4c64-8380-9331aefe77aa tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:16.764736 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-566ddca7-8da5-4c64-8380-9331aefe77aa tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:16.765487 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-566ddca7-8da5-4c64-8380-9331aefe77aa tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:16.765917 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-566ddca7-8da5-4c64-8380-9331aefe77aa tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:16.896908 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-566ddca7-8da5-4c64-8380-9331aefe77aa tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:35:16.904302 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-566ddca7-8da5-4c64-8380-9331aefe77aa tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f" status: 200 len: 1367 microversion: 2.1 time: 0.150846 Jun 07 14:35:16.904865 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 509/1055] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:35:16 2022] GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:35:17.921605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-40a62a05-153b-4538-b6bf-81140af22d0b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:35:17.922308 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-40a62a05-153b-4538-b6bf-81140af22d0b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:35:17.930605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-40a62a05-153b-4538-b6bf-81140af22d0b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:17.931051 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-40a62a05-153b-4538-b6bf-81140af22d0b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:17.931850 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-40a62a05-153b-4538-b6bf-81140af22d0b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:17.932478 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-40a62a05-153b-4538-b6bf-81140af22d0b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:18.070992 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-40a62a05-153b-4538-b6bf-81140af22d0b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:35:18.078144 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-40a62a05-153b-4538-b6bf-81140af22d0b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f" status: 200 len: 1367 microversion: 2.1 time: 0.160764 Jun 07 14:35:18.078978 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 547/1056] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:35:17 2022] GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:35:19.095561 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5431cc8b-ceb6-428e-b31c-b2cbec4fb7f9 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:35:19.096178 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-5431cc8b-ceb6-428e-b31c-b2cbec4fb7f9 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:35:19.098593 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:35:19.099645 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=6 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:35:19.105378 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5431cc8b-ceb6-428e-b31c-b2cbec4fb7f9 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:19.105822 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5431cc8b-ceb6-428e-b31c-b2cbec4fb7f9 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:19.106586 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5431cc8b-ceb6-428e-b31c-b2cbec4fb7f9 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:19.107017 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5431cc8b-ceb6-428e-b31c-b2cbec4fb7f9 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:19.239387 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-5431cc8b-ceb6-428e-b31c-b2cbec4fb7f9 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:35:19.246777 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-5431cc8b-ceb6-428e-b31c-b2cbec4fb7f9 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f" status: 200 len: 1556 microversion: 2.1 time: 0.155354 Jun 07 14:35:19.247363 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 510/1057] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:35:19 2022] GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:35:19.263188 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-efed4903-2665-4567-9532-f6cf7ed282d5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:35:19.263708 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-efed4903-2665-4567-9532-f6cf7ed282d5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:35:19.265593 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=6 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:35:19.271527 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-efed4903-2665-4567-9532-f6cf7ed282d5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:19.271978 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-efed4903-2665-4567-9532-f6cf7ed282d5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:19.272730 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-efed4903-2665-4567-9532-f6cf7ed282d5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:19.273162 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-efed4903-2665-4567-9532-f6cf7ed282d5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:19.350710 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-efed4903-2665-4567-9532-f6cf7ed282d5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091228 Jun 07 14:35:19.351334 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 548/1058] 10.222.0.81 () {58 vars in 1274 bytes} [Tue Jun 7 14:35:19 2022] GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:35:20.273527 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-dc44b803-e793-4a45-810d-c2106567263a req-283d881c-d48c-4c92-a530-f52036af7375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f", "tag": "c3e460f4-54c0-49e3-8447-65d616ce7aa7"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:35:20.282144 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-dc44b803-e793-4a45-810d-c2106567263a req-283d881c-d48c-4c92-a530-f52036af7375 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:20.283481 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-dc44b803-e793-4a45-810d-c2106567263a req-283d881c-d48c-4c92-a530-f52036af7375 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:20.287810 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:35:20.302097 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-dc44b803-e793-4a45-810d-c2106567263a req-283d881c-d48c-4c92-a530-f52036af7375 service nova] Creating event network-changed:c3e460f4-54c0-49e3-8447-65d616ce7aa7 for instance e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f on hv-cinder-83608 Jun 07 14:35:20.307927 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-dc44b803-e793-4a45-810d-c2106567263a req-283d881c-d48c-4c92-a530-f52036af7375 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037950 Jun 07 14:35:20.308531 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 511/1059] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:35:54.027037 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:35:54.027903 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:35:54.032127 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-0e129f1c-f3ef-4e43-bb5e-26512d14a27b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:35:54.032617 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-0e129f1c-f3ef-4e43-bb5e-26512d14a27b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:35:54.040528 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0e129f1c-f3ef-4e43-bb5e-26512d14a27b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:54.041017 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0e129f1c-f3ef-4e43-bb5e-26512d14a27b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:54.041834 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0e129f1c-f3ef-4e43-bb5e-26512d14a27b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:54.042268 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-0e129f1c-f3ef-4e43-bb5e-26512d14a27b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:54.067480 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-0e129f1c-f3ef-4e43-bb5e-26512d14a27b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f/ips" status: 200 len: 149 microversion: 2.1 time: 0.041956 Jun 07 14:35:54.068072 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 549/1060] 10.222.0.81 () {58 vars in 1247 bytes} [Tue Jun 7 14:35:54 2022] GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:35:55.378424 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:35:55.384129 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e0f43962-74e5-4b2f-bb20-6e506c0adbe0 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6382d18-b4fa-4ca0-b6aa-99b0a1ee6a52"}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:35:55.385265 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e0f43962-74e5-4b2f-bb20-6e506c0adbe0 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:35:55.393415 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e0f43962-74e5-4b2f-bb20-6e506c0adbe0 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:55.393867 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e0f43962-74e5-4b2f-bb20-6e506c0adbe0 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:55.394894 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e0f43962-74e5-4b2f-bb20-6e506c0adbe0 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:35:55.395368 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e0f43962-74e5-4b2f-bb20-6e506c0adbe0 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:35:55.637296 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e0f43962-74e5-4b2f-bb20-6e506c0adbe0 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "POST /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260200 Jun 07 14:35:55.637914 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 512/1061] 10.222.0.81 () {60 vars in 1322 bytes} [Tue Jun 7 14:35:55 2022] POST /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:36:02.067893 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-f3fcc5aa-2679-48c4-97b7-58ce442d8e73 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6382d18-b4fa-4ca0-b6aa-99b0a1ee6a52"}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:36:02.068941 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-f3fcc5aa-2679-48c4-97b7-58ce442d8e73 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:36:02.075387 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f3fcc5aa-2679-48c4-97b7-58ce442d8e73 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:02.075838 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f3fcc5aa-2679-48c4-97b7-58ce442d8e73 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:02.076598 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f3fcc5aa-2679-48c4-97b7-58ce442d8e73 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:02.077034 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-f3fcc5aa-2679-48c4-97b7-58ce442d8e73 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:02.154829 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-f3fcc5aa-2679-48c4-97b7-58ce442d8e73 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] HTTP exception thrown: Invalid volume: volume b6382d18-b4fa-4ca0-b6aa-99b0a1ee6a52 is already attached to instances: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f Jun 07 14:36:02.156605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-f3fcc5aa-2679-48c4-97b7-58ce442d8e73 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Request method failure captured: Jun 07 14:36:02.156605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: POST /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f/os-volume_attachments HTTP/1.1 Jun 07 14:36:02.156605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:36:02.156605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:36:02.156605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:36:02.156605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 74 Jun 07 14:36:02.156605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:36:02.156605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:36:02.156605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:36:02.156605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:36:02.156605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin2GmsS231yllZtsbD6a6Z0roy55x891gPcc4OtdxXF4ia4D01PLG2cf5i38tn1r77Y2duhhtCS-saERLzBOKttnlwNxM2_Zani_N974cPUmMl1oV_SdbtUyM9d8ZGCIsSvKvKBnrobWnrqVnsEDW4J_SJ4y0aZXDb9uZb1f3C1l69PM Jun 07 14:36:02.156605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:36:02.156605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:36:02.156605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:36:02.156605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:36:02.156605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:36:02.156605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:36:02.156605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:36:02.156605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:36:02.156605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:36:02.156605 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:36:02.158304 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a68951caf41c425cb3e1335e30d52a3c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}] Jun 07 14:36:02.158304 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:36:02.158304 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:36:02.158304 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:36:02.158304 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:36:02.158304 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:36:02.158304 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:36:02.158304 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: a52df1ab67cb42b69f333adede204a61 Jun 07 14:36:02.158304 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:36:02.158304 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Jun 07 14:36:02.158304 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {"volumeAttachment": {"volumeId": "b6382d18-b4fa-4ca0-b6aa-99b0a1ee6a52"}} Jun 07 14:36:02.158304 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:36:02.159290 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Invalid volume: volume b6382d18-b4fa-4ca0-b6aa-99b0a1ee6a52 is already attached to instances: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f Jun 07 14:36:02.159290 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'server_id': 'e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f', 'body': {'volumeAttachment': {'volumeId': 'b6382d18-b4fa-4ca0-b6aa-99b0a1ee6a52'}}} Jun 07 14:36:02.159290 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:36:02.159290 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:36:02.159290 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 14:36:02.159290 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 14:36:02.159290 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 14:36:02.159290 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 14:36:02.159290 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 07 14:36:02.159290 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 07 14:36:02.159290 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 07 14:36:02.159290 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 07 14:36:02.159290 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 07 14:36:02.159290 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 07 14:36:02.159290 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b6382d18-b4fa-4ca0-b6aa-99b0a1ee6a52 is already attached to instances: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f Jun 07 14:36:02.159290 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:36:02.159290 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:36:02.159290 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:36:02.159290 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:36:02.161000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:36:02.161000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:36:02.161000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:36:02.161000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:36:02.161000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:36:02.161000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:36:02.161000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 14:36:02.161000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 14:36:02.161000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 14:36:02.161000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 14:36:02.161000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 14:36:02.161000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 14:36:02.161000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 07 14:36:02.161000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 07 14:36:02.161000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b6382d18-b4fa-4ca0-b6aa-99b0a1ee6a52 is already attached to instances: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f Jun 07 14:36:02.161000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:36:02.161000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:36:02.161000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:36:02.161000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:36:02.161000 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:36:02.162648 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:36:02.162648 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:36:02.162648 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:36:02.162648 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b6382d18-b4fa-4ca0-b6aa-99b0a1ee6a52 is already attached to instances: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f Jun 07 14:36:02.162648 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:36:02.162648 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-f3fcc5aa-2679-48c4-97b7-58ce442d8e73 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Returning 400 to user: Invalid volume: volume b6382d18-b4fa-4ca0-b6aa-99b0a1ee6a52 is already attached to instances: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:36:02.162648 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-f3fcc5aa-2679-48c4-97b7-58ce442d8e73 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "POST /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094298 Jun 07 14:36:02.162648 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 550/1062] 10.222.0.81 () {60 vars in 1322 bytes} [Tue Jun 7 14:36:02 2022] POST /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 14:36:02.218960 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-070c9fb9-554c-4913-a4f7-d46e0fe1e1f9 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:36:02.219572 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-070c9fb9-554c-4913-a4f7-d46e0fe1e1f9 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:36:02.226054 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-070c9fb9-554c-4913-a4f7-d46e0fe1e1f9 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:02.226499 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-070c9fb9-554c-4913-a4f7-d46e0fe1e1f9 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:02.227297 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-070c9fb9-554c-4913-a4f7-d46e0fe1e1f9 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:02.227735 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-070c9fb9-554c-4913-a4f7-d46e0fe1e1f9 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:02.306489 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-070c9fb9-554c-4913-a4f7-d46e0fe1e1f9 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lazy-loading 'services' on Instance uuid e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:36:02.378224 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-070c9fb9-554c-4913-a4f7-d46e0fe1e1f9 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f/os-volume_attachments/b6382d18-b4fa-4ca0-b6aa-99b0a1ee6a52" status: 202 len: 0 microversion: 2.1 time: 0.163724 Jun 07 14:36:02.378855 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 513/1063] 10.222.0.81 () {58 vars in 1415 bytes} [Tue Jun 7 14:36:02 2022] DELETE /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f/os-volume_attachments/b6382d18-b4fa-4ca0-b6aa-99b0a1ee6a52 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:36:02.387241 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-64fc32a5-1994-4207-8dec-7958867cec5b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:36:02.388247 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-64fc32a5-1994-4207-8dec-7958867cec5b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:36:02.394379 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-64fc32a5-1994-4207-8dec-7958867cec5b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:02.394838 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-64fc32a5-1994-4207-8dec-7958867cec5b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:02.395684 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-64fc32a5-1994-4207-8dec-7958867cec5b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:02.396134 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-64fc32a5-1994-4207-8dec-7958867cec5b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:02.427143 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-64fc32a5-1994-4207-8dec-7958867cec5b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043785 Jun 07 14:36:02.428497 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 551/1064] 10.222.0.81 () {58 vars in 1301 bytes} [Tue Jun 7 14:36:02 2022] GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:36:03.441473 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-bbd8640a-8368-4ead-830f-4bbd788ed309 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:36:03.442487 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-bbd8640a-8368-4ead-830f-4bbd788ed309 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:36:03.449313 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bbd8640a-8368-4ead-830f-4bbd788ed309 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:03.449762 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bbd8640a-8368-4ead-830f-4bbd788ed309 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:03.450533 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bbd8640a-8368-4ead-830f-4bbd788ed309 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:03.450970 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bbd8640a-8368-4ead-830f-4bbd788ed309 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:03.479011 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-bbd8640a-8368-4ead-830f-4bbd788ed309 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042467 Jun 07 14:36:03.479596 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 514/1065] 10.222.0.81 () {58 vars in 1301 bytes} [Tue Jun 7 14:36:03 2022] GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 14:36:03.535946 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ce10b607-f298-4db4-b5d4-d133a4763f29 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:36:03.536441 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ce10b607-f298-4db4-b5d4-d133a4763f29 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:36:03.543447 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ce10b607-f298-4db4-b5d4-d133a4763f29 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:03.543894 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ce10b607-f298-4db4-b5d4-d133a4763f29 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:03.544653 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ce10b607-f298-4db4-b5d4-d133a4763f29 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:03.545091 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ce10b607-f298-4db4-b5d4-d133a4763f29 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:03.572858 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ce10b607-f298-4db4-b5d4-d133a4763f29 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Going to try to terminate instance {{(pid=117565) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:36:03.649681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ce10b607-f298-4db4-b5d4-d133a4763f29 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f" status: 204 len: 0 microversion: 2.1 time: 0.117220 Jun 07 14:36:03.650562 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 552/1066] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:36:03 2022] DELETE /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:36:03.660648 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-21246561-8e15-48f6-a023-91b53ec233b3 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:36:03.661258 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-21246561-8e15-48f6-a023-91b53ec233b3 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:36:03.668068 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-21246561-8e15-48f6-a023-91b53ec233b3 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:03.668513 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-21246561-8e15-48f6-a023-91b53ec233b3 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:03.669268 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-21246561-8e15-48f6-a023-91b53ec233b3 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:03.669701 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-21246561-8e15-48f6-a023-91b53ec233b3 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:03.798567 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-21246561-8e15-48f6-a023-91b53ec233b3 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:36:03.806754 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-21246561-8e15-48f6-a023-91b53ec233b3 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f" status: 200 len: 1681 microversion: 2.1 time: 0.150577 Jun 07 14:36:03.807342 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 515/1067] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:36:03 2022] GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:36:04.825029 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3cbd7854-fd03-4235-876b-d0642f00c222 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:36:04.825728 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-3cbd7854-fd03-4235-876b-d0642f00c222 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:36:04.832251 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3cbd7854-fd03-4235-876b-d0642f00c222 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:04.832702 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3cbd7854-fd03-4235-876b-d0642f00c222 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:04.833463 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3cbd7854-fd03-4235-876b-d0642f00c222 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:04.833915 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3cbd7854-fd03-4235-876b-d0642f00c222 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:04.961005 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-3cbd7854-fd03-4235-876b-d0642f00c222 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:36:04.968377 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-3cbd7854-fd03-4235-876b-d0642f00c222 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f" status: 200 len: 1681 microversion: 2.1 time: 0.147568 Jun 07 14:36:04.968938 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 553/1068] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:36:04 2022] GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:36:05.985701 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-220dc7f9-0706-4233-89b3-ea8216a73b7d tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:36:05.986347 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-220dc7f9-0706-4233-89b3-ea8216a73b7d tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:36:05.993601 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-220dc7f9-0706-4233-89b3-ea8216a73b7d tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:05.994047 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-220dc7f9-0706-4233-89b3-ea8216a73b7d tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:05.994872 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-220dc7f9-0706-4233-89b3-ea8216a73b7d tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:05.995341 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-220dc7f9-0706-4233-89b3-ea8216a73b7d tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:06.061668 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-220dc7f9-0706-4233-89b3-ea8216a73b7d tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:36:06.069937 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-220dc7f9-0706-4233-89b3-ea8216a73b7d tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f" status: 200 len: 1614 microversion: 2.1 time: 0.088111 Jun 07 14:36:06.070510 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 516/1069] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:36:05 2022] GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f => generated 1614 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:36:06.141178 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-fde978c6-3509-496e-be98-392cc731a1c0 req-03fc3582-084f-49a7-b1ca-567f2bd2dc6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f", "name": "network-vif-deleted", "tag": "c3e460f4-54c0-49e3-8447-65d616ce7aa7"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:36:06.150404 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-fde978c6-3509-496e-be98-392cc731a1c0 req-03fc3582-084f-49a7-b1ca-567f2bd2dc6d service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:06.150856 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-fde978c6-3509-496e-be98-392cc731a1c0 req-03fc3582-084f-49a7-b1ca-567f2bd2dc6d service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:06.165186 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-fde978c6-3509-496e-be98-392cc731a1c0 req-03fc3582-084f-49a7-b1ca-567f2bd2dc6d service nova] Creating event network-vif-deleted:c3e460f4-54c0-49e3-8447-65d616ce7aa7 for instance e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f on hv-cinder-83608 Jun 07 14:36:06.170966 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-fde978c6-3509-496e-be98-392cc731a1c0 req-03fc3582-084f-49a7-b1ca-567f2bd2dc6d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033370 Jun 07 14:36:06.171886 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 554/1070] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:36:07.086901 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3ea0ea14-4c38-4b6e-aea2-a81c541eac1c tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:36:07.087550 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-3ea0ea14-4c38-4b6e-aea2-a81c541eac1c tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:36:07.094046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3ea0ea14-4c38-4b6e-aea2-a81c541eac1c tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:07.094498 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3ea0ea14-4c38-4b6e-aea2-a81c541eac1c tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:07.095291 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3ea0ea14-4c38-4b6e-aea2-a81c541eac1c tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:07.095734 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-3ea0ea14-4c38-4b6e-aea2-a81c541eac1c tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:07.109712 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-3ea0ea14-4c38-4b6e-aea2-a81c541eac1c tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] HTTP exception thrown: Instance e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f could not be found. Jun 07 14:36:07.111395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3ea0ea14-4c38-4b6e-aea2-a81c541eac1c tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Request method failure captured: Jun 07 14:36:07.111395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f HTTP/1.1 Jun 07 14:36:07.111395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 07 14:36:07.111395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 07 14:36:07.111395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Connection: close Jun 07 14:36:07.111395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 07 14:36:07.111395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 07 14:36:07.111395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Host: 10.222.0.81 Jun 07 14:36:07.111395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 07 14:36:07.111395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 07 14:36:07.111395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABin2GmsS231yllZtsbD6a6Z0roy55x891gPcc4OtdxXF4ia4D01PLG2cf5i38tn1r77Y2duhhtCS-saERLzBOKttnlwNxM2_Zani_N974cPUmMl1oV_SdbtUyM9d8ZGCIsSvKvKBnrobWnrqVnsEDW4J_SJ4y0aZXDb9uZb1f3C1l69PM Jun 07 14:36:07.111395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 07 14:36:07.111395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 07 14:36:07.111395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 07 14:36:07.111395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 07 14:36:07.111395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 07 14:36:07.111395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 07 14:36:07.111395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:36:07.111395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:36:07.111395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Role: member,reader Jun 07 14:36:07.111395 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Roles: member,reader Jun 07 14:36:07.113068 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a68951caf41c425cb3e1335e30d52a3c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}] Jun 07 14:36:07.113068 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:36:07.113068 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:36:07.113068 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:36:07.113068 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:36:07.113068 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 07 14:36:07.113068 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 07 14:36:07.113068 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Id: a52df1ab67cb42b69f333adede204a61 Jun 07 14:36:07.113068 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:36:07.113068 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: method: > Jun 07 14:36:07.113068 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: exception: Instance e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f could not be found. Jun 07 14:36:07.113068 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: action_args: {'id': 'e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f'} Jun 07 14:36:07.118236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:36:07.118236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:36:07.118236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:36:07.118236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:36:07.118236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:36:07.118236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:36:07.118236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:36:07.118236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:36:07.118236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:36:07.118236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:36:07.118236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f could not be found. Jun 07 14:36:07.118236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:36:07.118236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:36:07.118236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:36:07.118236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:36:07.118236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:36:07.118236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:36:07.118236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:36:07.118236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:36:07.118236 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:36:07.119948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:36:07.119948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:36:07.119948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:36:07.119948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:36:07.119948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:36:07.119948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:36:07.119948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:36:07.119948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f could not be found. Jun 07 14:36:07.119948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:36:07.119948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:36:07.119948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:36:07.119948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:36:07.119948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:36:07.119948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:36:07.119948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:36:07.119948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:36:07.119948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f could not be found. Jun 07 14:36:07.119948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:36:07.121475 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-3ea0ea14-4c38-4b6e-aea2-a81c541eac1c tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Returning 404 to user: Instance e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:36:07.121475 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-3ea0ea14-4c38-4b6e-aea2-a81c541eac1c tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f" status: 404 len: 111 microversion: 2.1 time: 0.029857 Jun 07 14:36:07.121475 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 517/1071] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:36:07 2022] GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:36:07.123074 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-b505d944-7ffc-4b55-b741-ffa312bd1bed tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '.version_select at 0x7ff388667670>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:36:07.140832 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-b505d944-7ffc-4b55-b741-ffa312bd1bed tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1045380591" status: 202 len: 0 microversion: 2.1 time: 0.021811 Jun 07 14:36:07.141411 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 555/1072] 10.222.0.81 () {58 vars in 1220 bytes} [Tue Jun 7 14:36:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1045380591 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:36:07.761363 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-c613cfa3-35e8-4f54-9efe-c5c03021e4fb tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Action: 'create', calling method: .version_select at 0x7ff37f7a5040>, body: {"keypair": {"name": "tempest-keypair-1768096013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIS6rd7cNCOHU3xrJhcS+fowWsCcwOT94xCmRI63ZvMTsfMQvGGjR4goAGhuDBUi4nZyD9SDtFuLsmTvyO6gvWREMTwK6r6NBR/hL2E90Lw8tuwV1wveLl5bAecpSSEEsQ=="}} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:36:07.775993 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-c613cfa3-35e8-4f54-9efe-c5c03021e4fb tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Getting quotas for project a68951caf41c425cb3e1335e30d52a3c. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:36:07.779832 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.quota [None req-c613cfa3-35e8-4f54-9efe-c5c03021e4fb tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Getting quotas for user a52df1ab67cb42b69f333adede204a61 and project a68951caf41c425cb3e1335e30d52a3c. Resources: {'key_pairs'} {{(pid=117564) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:36:07.801138 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-c613cfa3-35e8-4f54-9efe-c5c03021e4fb tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043912 Jun 07 14:36:07.804213 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 518/1073] 10.222.0.81 () {60 vars in 1158 bytes} [Tue Jun 7 14:36:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:36:09.028249 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7f9cb6fe-dd1a-4c00-a611-371b7b186dfc tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1477799428", "imageRef": "2864004b-970a-480b-8453-14794f9ccca2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "33f78b17-9d5e-40c8-a0e8-fff86f3c9b61"}], "security_groups": [{"name": "tempest-securitygroup--2084327827"}], "key_name": "tempest-keypair-1768096013", "user_data": "}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:36:09.129686 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.network.neutron [None req-7f9cb6fe-dd1a-4c00-a611-371b7b186dfc tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] validate_networks() for [('33f78b17-9d5e-40c8-a0e8-fff86f3c9b61', None, None, None, None, None)] {{(pid=117565) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:36:09.494978 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-7f9cb6fe-dd1a-4c00-a611-371b7b186dfc tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Flavor limits 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:36:09.495452 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-7f9cb6fe-dd1a-4c00-a611-371b7b186dfc tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Image limits 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:36:09.495939 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-7f9cb6fe-dd1a-4c00-a611-371b7b186dfc tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Flavor pref 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:36:09.496386 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-7f9cb6fe-dd1a-4c00-a611-371b7b186dfc tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Image pref 0:0:0 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:36:09.496807 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.virt.hardware [None req-7f9cb6fe-dd1a-4c00-a611-371b7b186dfc tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:36:09.505951 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7f9cb6fe-dd1a-4c00-a611-371b7b186dfc tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:09.506405 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7f9cb6fe-dd1a-4c00-a611-371b7b186dfc tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:09.507305 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7f9cb6fe-dd1a-4c00-a611-371b7b186dfc tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:09.507687 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7f9cb6fe-dd1a-4c00-a611-371b7b186dfc tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:09.524778 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-7f9cb6fe-dd1a-4c00-a611-371b7b186dfc tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Getting quotas for project a68951caf41c425cb3e1335e30d52a3c. Resources: {'ram', 'cores', 'instances'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:36:09.528869 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.quota [None req-7f9cb6fe-dd1a-4c00-a611-371b7b186dfc tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Getting quotas for user a52df1ab67cb42b69f333adede204a61 and project a68951caf41c425cb3e1335e30d52a3c. Resources: {'ram', 'cores', 'instances'} {{(pid=117565) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:36:09.540371 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-7f9cb6fe-dd1a-4c00-a611-371b7b186dfc tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Going to run 1 instances... {{(pid=117565) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:36:09.542686 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-7f9cb6fe-dd1a-4c00-a611-371b7b186dfc tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2864004b-970a-480b-8453-14794f9ccca2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:36:09.589154 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-7f9cb6fe-dd1a-4c00-a611-371b7b186dfc tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.565648 Jun 07 14:36:09.589726 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 556/1074] 10.222.0.81 () {60 vars in 1146 bytes} [Tue Jun 7 14:36:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:36:09.601081 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8766de5c-05a4-4b1a-9ff3-ad306b7c8530 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:36:09.601710 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8766de5c-05a4-4b1a-9ff3-ad306b7c8530 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:36:09.656646 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-8766de5c-05a4-4b1a-9ff3-ad306b7c8530 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:36:09.664653 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8766de5c-05a4-4b1a-9ff3-ad306b7c8530 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb" status: 200 len: 1242 microversion: 2.1 time: 0.068909 Jun 07 14:36:09.669269 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 519/1075] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:36:09 2022] GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:36:10.682327 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-d9aa7c9a-ce73-47ae-b6d1-26478c3ddcd7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:36:10.683059 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-d9aa7c9a-ce73-47ae-b6d1-26478c3ddcd7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:36:10.690681 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d9aa7c9a-ce73-47ae-b6d1-26478c3ddcd7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:10.691133 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d9aa7c9a-ce73-47ae-b6d1-26478c3ddcd7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:10.691988 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d9aa7c9a-ce73-47ae-b6d1-26478c3ddcd7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:10.692431 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-d9aa7c9a-ce73-47ae-b6d1-26478c3ddcd7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:10.754370 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-d9aa7c9a-ce73-47ae-b6d1-26478c3ddcd7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:36:10.762535 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-d9aa7c9a-ce73-47ae-b6d1-26478c3ddcd7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb" status: 200 len: 1300 microversion: 2.1 time: 0.085217 Jun 07 14:36:10.763160 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 557/1076] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:36:10 2022] GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:36:11.780297 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-77a9bf4f-1f21-42e6-b748-38d9cd5775c5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:36:11.781052 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-77a9bf4f-1f21-42e6-b748-38d9cd5775c5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:36:11.788466 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-77a9bf4f-1f21-42e6-b748-38d9cd5775c5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:11.788923 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-77a9bf4f-1f21-42e6-b748-38d9cd5775c5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:11.789699 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-77a9bf4f-1f21-42e6-b748-38d9cd5775c5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:11.790137 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-77a9bf4f-1f21-42e6-b748-38d9cd5775c5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:11.925379 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-77a9bf4f-1f21-42e6-b748-38d9cd5775c5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:36:11.938753 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-77a9bf4f-1f21-42e6-b748-38d9cd5775c5 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb" status: 200 len: 1368 microversion: 2.1 time: 0.162268 Jun 07 14:36:11.939562 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 520/1077] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:36:11 2022] GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:36:12.118492 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-b3395fea-9930-4d93-ab79-707f6ffccedc req-3f989244-79df-44c8-9ab3-09c44090d6cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54d3f092-3c5a-43d0-99c6-ac4f31ba87cb", "tag": "ec708b9e-7e74-4fa9-a9c2-cdc9edf1ff5c"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:36:12.128895 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-b3395fea-9930-4d93-ab79-707f6ffccedc req-3f989244-79df-44c8-9ab3-09c44090d6cc service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:12.129631 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-b3395fea-9930-4d93-ab79-707f6ffccedc req-3f989244-79df-44c8-9ab3-09c44090d6cc service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:12.140948 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-b3395fea-9930-4d93-ab79-707f6ffccedc req-3f989244-79df-44c8-9ab3-09c44090d6cc service nova] Creating event network-changed:ec708b9e-7e74-4fa9-a9c2-cdc9edf1ff5c for instance 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb on hv-cinder-83608 Jun 07 14:36:12.145792 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-b3395fea-9930-4d93-ab79-707f6ffccedc req-3f989244-79df-44c8-9ab3-09c44090d6cc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031760 Jun 07 14:36:12.146438 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 558/1078] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:36:12.955900 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-605ddeeb-edc9-4e37-97e8-1960307df8a4 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:36:12.956440 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-605ddeeb-edc9-4e37-97e8-1960307df8a4 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:36:12.962955 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-605ddeeb-edc9-4e37-97e8-1960307df8a4 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:12.963434 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-605ddeeb-edc9-4e37-97e8-1960307df8a4 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:12.964190 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-605ddeeb-edc9-4e37-97e8-1960307df8a4 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:12.964623 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-605ddeeb-edc9-4e37-97e8-1960307df8a4 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:13.094720 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-605ddeeb-edc9-4e37-97e8-1960307df8a4 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:36:13.103047 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-605ddeeb-edc9-4e37-97e8-1960307df8a4 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb" status: 200 len: 1368 microversion: 2.1 time: 0.151086 Jun 07 14:36:13.103640 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 521/1079] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:36:12 2022] GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:36:14.120768 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-e6885234-85b8-4d56-b8df-8953a25f998d tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:36:14.121469 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-e6885234-85b8-4d56-b8df-8953a25f998d tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:36:14.127694 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e6885234-85b8-4d56-b8df-8953a25f998d tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:14.128146 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e6885234-85b8-4d56-b8df-8953a25f998d tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:14.128910 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e6885234-85b8-4d56-b8df-8953a25f998d tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:14.129350 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-e6885234-85b8-4d56-b8df-8953a25f998d tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:14.264402 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-e6885234-85b8-4d56-b8df-8953a25f998d tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:36:14.271998 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-e6885234-85b8-4d56-b8df-8953a25f998d tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb" status: 200 len: 1368 microversion: 2.1 time: 0.155900 Jun 07 14:36:14.272563 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 559/1080] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:36:14 2022] GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:36:15.289643 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-fd532b82-52a0-4032-bb20-5d42f5a955f7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:36:15.290258 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-fd532b82-52a0-4032-bb20-5d42f5a955f7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:36:15.296758 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fd532b82-52a0-4032-bb20-5d42f5a955f7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:15.297205 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fd532b82-52a0-4032-bb20-5d42f5a955f7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:15.297964 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fd532b82-52a0-4032-bb20-5d42f5a955f7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:15.298397 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-fd532b82-52a0-4032-bb20-5d42f5a955f7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:15.429417 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-fd532b82-52a0-4032-bb20-5d42f5a955f7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:36:15.436824 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-fd532b82-52a0-4032-bb20-5d42f5a955f7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb" status: 200 len: 1368 microversion: 2.1 time: 0.151902 Jun 07 14:36:15.437381 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 522/1081] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:36:15 2022] GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:36:16.453905 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-3995b3c5-6c32-4932-b461-d6f67028b34b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:36:16.454533 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-3995b3c5-6c32-4932-b461-d6f67028b34b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:36:16.461641 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3995b3c5-6c32-4932-b461-d6f67028b34b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:16.462097 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3995b3c5-6c32-4932-b461-d6f67028b34b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:16.462869 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3995b3c5-6c32-4932-b461-d6f67028b34b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:16.463347 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-3995b3c5-6c32-4932-b461-d6f67028b34b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:16.546640 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-b0ace963-778d-4cf0-ab02-2266d11a0d4f req-d2dc1ded-520f-49b9-8580-a2930354657e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54d3f092-3c5a-43d0-99c6-ac4f31ba87cb", "name": "network-vif-plugged", "status": "completed", "tag": "ec708b9e-7e74-4fa9-a9c2-cdc9edf1ff5c"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:36:16.557330 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-b0ace963-778d-4cf0-ab02-2266d11a0d4f req-d2dc1ded-520f-49b9-8580-a2930354657e service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:16.557816 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-b0ace963-778d-4cf0-ab02-2266d11a0d4f req-d2dc1ded-520f-49b9-8580-a2930354657e service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:16.570650 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-b0ace963-778d-4cf0-ab02-2266d11a0d4f req-d2dc1ded-520f-49b9-8580-a2930354657e service nova] Creating event network-vif-plugged:ec708b9e-7e74-4fa9-a9c2-cdc9edf1ff5c for instance 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb on hv-cinder-83608 Jun 07 14:36:16.576122 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-b0ace963-778d-4cf0-ab02-2266d11a0d4f req-d2dc1ded-520f-49b9-8580-a2930354657e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033271 Jun 07 14:36:16.576721 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 523/1082] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:36:16.598493 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-3995b3c5-6c32-4932-b461-d6f67028b34b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:36:16.606818 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-3995b3c5-6c32-4932-b461-d6f67028b34b tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb" status: 200 len: 1368 microversion: 2.1 time: 0.156723 Jun 07 14:36:16.607509 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 560/1083] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:36:16 2022] GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:36:17.625485 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-71b3b8c8-530e-4d68-91de-d1a3debcb89a tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:36:17.626225 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-71b3b8c8-530e-4d68-91de-d1a3debcb89a tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:36:17.633086 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-71b3b8c8-530e-4d68-91de-d1a3debcb89a tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:17.633527 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-71b3b8c8-530e-4d68-91de-d1a3debcb89a tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:17.634295 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-71b3b8c8-530e-4d68-91de-d1a3debcb89a tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:17.634730 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-71b3b8c8-530e-4d68-91de-d1a3debcb89a tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:17.766523 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-71b3b8c8-530e-4d68-91de-d1a3debcb89a tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:36:17.775701 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-71b3b8c8-530e-4d68-91de-d1a3debcb89a tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb" status: 200 len: 1368 microversion: 2.1 time: 0.154765 Jun 07 14:36:17.776501 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 524/1084] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:36:17 2022] GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:36:18.792409 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-6d36f56a-8312-4a8b-aa94-86560fe427a2 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:36:18.793022 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-6d36f56a-8312-4a8b-aa94-86560fe427a2 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:36:18.799544 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6d36f56a-8312-4a8b-aa94-86560fe427a2 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:18.799995 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6d36f56a-8312-4a8b-aa94-86560fe427a2 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:18.800749 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6d36f56a-8312-4a8b-aa94-86560fe427a2 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:18.801186 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-6d36f56a-8312-4a8b-aa94-86560fe427a2 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:18.928278 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-6d36f56a-8312-4a8b-aa94-86560fe427a2 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:36:18.935826 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-6d36f56a-8312-4a8b-aa94-86560fe427a2 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb" status: 200 len: 1557 microversion: 2.1 time: 0.147433 Jun 07 14:36:18.936389 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 561/1085] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:36:18 2022] GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:36:18.952535 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-0a03b845-7365-4221-8843-3256668a5a72 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:36:18.953041 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-0a03b845-7365-4221-8843-3256668a5a72 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:36:18.960103 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0a03b845-7365-4221-8843-3256668a5a72 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:18.960552 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0a03b845-7365-4221-8843-3256668a5a72 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:18.961324 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0a03b845-7365-4221-8843-3256668a5a72 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:18.961766 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-0a03b845-7365-4221-8843-3256668a5a72 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:19.041118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-0a03b845-7365-4221-8843-3256668a5a72 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092343 Jun 07 14:36:19.041764 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 525/1086] 10.222.0.81 () {58 vars in 1274 bytes} [Tue Jun 7 14:36:18 2022] GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:36:20.220772 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [req-56c8d19b-50c2-493d-8282-eb97e398288c req-ecb6d87d-616b-4539-bd64-8f2bd3fa3c7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54d3f092-3c5a-43d0-99c6-ac4f31ba87cb", "tag": "ec708b9e-7e74-4fa9-a9c2-cdc9edf1ff5c"}]} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:36:20.224318 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=2 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:36:20.226158 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell0:SELECT=6 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:36:20.232929 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-56c8d19b-50c2-493d-8282-eb97e398288c req-ecb6d87d-616b-4539-bd64-8f2bd3fa3c7f service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:20.233377 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [req-56c8d19b-50c2-493d-8282-eb97e398288c req-ecb6d87d-616b-4539-bd64-8f2bd3fa3c7f service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:20.245124 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.compute.server_external_events [req-56c8d19b-50c2-493d-8282-eb97e398288c req-ecb6d87d-616b-4539-bd64-8f2bd3fa3c7f service nova] Creating event network-changed:ec708b9e-7e74-4fa9-a9c2-cdc9edf1ff5c for instance 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb on hv-cinder-83608 Jun 07 14:36:20.249990 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [req-56c8d19b-50c2-493d-8282-eb97e398288c req-ecb6d87d-616b-4539-bd64-8f2bd3fa3c7f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032889 Jun 07 14:36:20.250608 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 562/1087] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:36:53.995308 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell0:SELECT=6 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:36:53.996776 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:36:53.997329 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG dbcounter [-] [117564] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:36:54.001599 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-7c242016-bae5-4c2f-ad7d-6ff29200dce7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:36:54.002093 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-7c242016-bae5-4c2f-ad7d-6ff29200dce7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:36:54.010808 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7c242016-bae5-4c2f-ad7d-6ff29200dce7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:54.011283 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7c242016-bae5-4c2f-ad7d-6ff29200dce7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:54.012050 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7c242016-bae5-4c2f-ad7d-6ff29200dce7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:54.012488 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-7c242016-bae5-4c2f-ad7d-6ff29200dce7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:54.036593 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-7c242016-bae5-4c2f-ad7d-6ff29200dce7 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb/ips" status: 200 len: 148 microversion: 2.1 time: 0.042136 Jun 07 14:36:54.037160 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 526/1088] 10.222.0.81 () {58 vars in 1247 bytes} [Tue Jun 7 14:36:53 2022] GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb/ips => generated 148 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:36:55.346053 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:36:55.346967 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG dbcounter [-] [117565] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:36:55.352329 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-db18bb13-b47c-47a5-a28a-5203c4841142 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1461a2bb-37d2-45b2-a46e-6e864091e1ee"}} {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:36:55.353501 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-db18bb13-b47c-47a5-a28a-5203c4841142 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:36:55.361584 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-db18bb13-b47c-47a5-a28a-5203c4841142 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:55.362039 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-db18bb13-b47c-47a5-a28a-5203c4841142 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:55.362836 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-db18bb13-b47c-47a5-a28a-5203c4841142 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:36:55.363311 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-db18bb13-b47c-47a5-a28a-5203c4841142 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:36:55.798461 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-db18bb13-b47c-47a5-a28a-5203c4841142 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "POST /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.453658 Jun 07 14:36:55.799112 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 563/1089] 10.222.0.81 () {60 vars in 1322 bytes} [Tue Jun 7 14:36:55 2022] POST /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb/os-volume_attachments => generated 194 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:37:02.329180 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8c171fcf-dd28-4a22-ae44-481da7619e08 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:02.329734 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8c171fcf-dd28-4a22-ae44-481da7619e08 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:37:02.336498 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8c171fcf-dd28-4a22-ae44-481da7619e08 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:02.336948 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8c171fcf-dd28-4a22-ae44-481da7619e08 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:02.337715 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8c171fcf-dd28-4a22-ae44-481da7619e08 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:02.338152 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8c171fcf-dd28-4a22-ae44-481da7619e08 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:02.469394 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.objects.instance [None req-8c171fcf-dd28-4a22-ae44-481da7619e08 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lazy-loading 'services' on Instance uuid 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb {{(pid=117564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:37:02.540670 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8c171fcf-dd28-4a22-ae44-481da7619e08 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "DELETE /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb/os-volume_attachments/1461a2bb-37d2-45b2-a46e-6e864091e1ee" status: 202 len: 0 microversion: 2.1 time: 0.215315 Jun 07 14:37:02.541304 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 527/1090] 10.222.0.81 () {58 vars in 1415 bytes} [Tue Jun 7 14:37:02 2022] DELETE /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb/os-volume_attachments/1461a2bb-37d2-45b2-a46e-6e864091e1ee => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:37:02.550491 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-642a9355-a425-4994-aa62-95395dfe3ea2 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:02.551691 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-642a9355-a425-4994-aa62-95395dfe3ea2 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:37:02.558385 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-642a9355-a425-4994-aa62-95395dfe3ea2 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:02.558805 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-642a9355-a425-4994-aa62-95395dfe3ea2 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:02.559647 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-642a9355-a425-4994-aa62-95395dfe3ea2 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:02.560168 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-642a9355-a425-4994-aa62-95395dfe3ea2 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:02.590747 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-642a9355-a425-4994-aa62-95395dfe3ea2 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044944 Jun 07 14:37:02.591323 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 564/1091] 10.222.0.81 () {58 vars in 1301 bytes} [Tue Jun 7 14:37:02 2022] GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:37:03.604622 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-bbfe65d2-7237-47bd-a895-f02fba8ae851 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:03.605649 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-bbfe65d2-7237-47bd-a895-f02fba8ae851 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:37:03.611845 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bbfe65d2-7237-47bd-a895-f02fba8ae851 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:03.612312 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bbfe65d2-7237-47bd-a895-f02fba8ae851 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:03.613071 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bbfe65d2-7237-47bd-a895-f02fba8ae851 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:03.613518 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bbfe65d2-7237-47bd-a895-f02fba8ae851 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:03.642271 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-bbfe65d2-7237-47bd-a895-f02fba8ae851 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043680 Jun 07 14:37:03.642817 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 528/1092] 10.222.0.81 () {58 vars in 1301 bytes} [Tue Jun 7 14:37:03 2022] GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 14:37:03.699788 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-817ead62-40d6-4354-a6fa-8e07cf9e24f6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:03.700316 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-817ead62-40d6-4354-a6fa-8e07cf9e24f6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:37:03.706602 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-817ead62-40d6-4354-a6fa-8e07cf9e24f6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:03.707091 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-817ead62-40d6-4354-a6fa-8e07cf9e24f6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:03.707881 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-817ead62-40d6-4354-a6fa-8e07cf9e24f6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:03.708318 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-817ead62-40d6-4354-a6fa-8e07cf9e24f6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:03.733382 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-817ead62-40d6-4354-a6fa-8e07cf9e24f6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb] Going to try to terminate instance {{(pid=117565) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:37:03.808646 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-817ead62-40d6-4354-a6fa-8e07cf9e24f6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "DELETE /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb" status: 204 len: 0 microversion: 2.1 time: 0.112165 Jun 07 14:37:03.809219 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 565/1093] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:37:03 2022] DELETE /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:37:03.817988 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-9177f855-5810-4d87-881d-3f71f94f9118 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:03.818591 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-9177f855-5810-4d87-881d-3f71f94f9118 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:37:03.825217 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9177f855-5810-4d87-881d-3f71f94f9118 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:03.825722 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9177f855-5810-4d87-881d-3f71f94f9118 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:03.826543 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9177f855-5810-4d87-881d-3f71f94f9118 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:03.827029 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-9177f855-5810-4d87-881d-3f71f94f9118 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:03.958701 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.policy [None req-9177f855-5810-4d87-881d-3f71f94f9118 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117564) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:37:03.967188 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-9177f855-5810-4d87-881d-3f71f94f9118 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb" status: 200 len: 1681 microversion: 2.1 time: 0.153297 Jun 07 14:37:03.967782 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 529/1094] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:37:03 2022] GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:37:04.985357 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-15b39c22-e72d-444e-a178-44274bbf1776 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:04.986053 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-15b39c22-e72d-444e-a178-44274bbf1776 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:37:04.992839 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-15b39c22-e72d-444e-a178-44274bbf1776 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:04.993284 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-15b39c22-e72d-444e-a178-44274bbf1776 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:04.994047 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-15b39c22-e72d-444e-a178-44274bbf1776 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:04.994484 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-15b39c22-e72d-444e-a178-44274bbf1776 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:05.124028 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-15b39c22-e72d-444e-a178-44274bbf1776 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:37:05.136441 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-15b39c22-e72d-444e-a178-44274bbf1776 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb" status: 200 len: 1681 microversion: 2.1 time: 0.150334 Jun 07 14:37:05.137276 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 566/1095] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:37:04 2022] GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:37:06.157030 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-bfd01a6a-faea-421c-9c3f-588ff430eb0c tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:06.160695 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-bfd01a6a-faea-421c-9c3f-588ff430eb0c tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:37:06.182623 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bfd01a6a-faea-421c-9c3f-588ff430eb0c tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:06.184463 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bfd01a6a-faea-421c-9c3f-588ff430eb0c tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:06.185866 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bfd01a6a-faea-421c-9c3f-588ff430eb0c tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:06.186601 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-bfd01a6a-faea-421c-9c3f-588ff430eb0c tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:06.219988 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [req-4c7f011a-d6cb-49b7-a12f-8953768937da req-0e601831-9474-40e0-b3b1-c83688d9c130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54d3f092-3c5a-43d0-99c6-ac4f31ba87cb", "name": "network-vif-deleted", "tag": "ec708b9e-7e74-4fa9-a9c2-cdc9edf1ff5c"}]} {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:37:06.236238 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-4c7f011a-d6cb-49b7-a12f-8953768937da req-0e601831-9474-40e0-b3b1-c83688d9c130 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:06.236917 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [req-4c7f011a-d6cb-49b7-a12f-8953768937da req-0e601831-9474-40e0-b3b1-c83688d9c130 service nova] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:06.255156 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.compute.server_external_events [req-4c7f011a-d6cb-49b7-a12f-8953768937da req-0e601831-9474-40e0-b3b1-c83688d9c130 service nova] Creating event network-vif-deleted:ec708b9e-7e74-4fa9-a9c2-cdc9edf1ff5c for instance 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb on hv-cinder-83608 Jun 07 14:37:06.265442 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [req-4c7f011a-d6cb-49b7-a12f-8953768937da req-0e601831-9474-40e0-b3b1-c83688d9c130 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115751 Jun 07 14:37:06.266098 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 530/1096] 10.222.0.81 () {64 vars in 1317 bytes} [Tue Jun 7 14:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:37:06.281211 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.policy [None req-bfd01a6a-faea-421c-9c3f-588ff430eb0c tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52df1ab67cb42b69f333adede204a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68951caf41c425cb3e1335e30d52a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117565) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:37:06.290568 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-bfd01a6a-faea-421c-9c3f-588ff430eb0c tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb" status: 200 len: 1327 microversion: 2.1 time: 0.139990 Jun 07 14:37:06.291432 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 567/1097] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:37:06 2022] GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb => generated 1327 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:37:07.308822 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e4bf912d-46c4-4e7e-bafe-44328cc0a524 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:07.309441 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-e4bf912d-46c4-4e7e-bafe-44328cc0a524 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:37:07.315769 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e4bf912d-46c4-4e7e-bafe-44328cc0a524 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:07.316219 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e4bf912d-46c4-4e7e-bafe-44328cc0a524 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:07.316995 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e4bf912d-46c4-4e7e-bafe-44328cc0a524 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:07.317440 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-e4bf912d-46c4-4e7e-bafe-44328cc0a524 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:07.331172 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-e4bf912d-46c4-4e7e-bafe-44328cc0a524 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] HTTP exception thrown: Instance 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb could not be found. Jun 07 14:37:07.332836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e4bf912d-46c4-4e7e-bafe-44328cc0a524 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Request method failure captured: Jun 07 14:37:07.332836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: request: GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb HTTP/1.1 Jun 07 14:37:07.332836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 07 14:37:07.332836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 07 14:37:07.332836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Connection: close Jun 07 14:37:07.332836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 07 14:37:07.332836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 07 14:37:07.332836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Host: 10.222.0.81 Jun 07 14:37:07.332836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 07 14:37:07.332836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 07 14:37:07.332836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABin2GmsS231yllZtsbD6a6Z0roy55x891gPcc4OtdxXF4ia4D01PLG2cf5i38tn1r77Y2duhhtCS-saERLzBOKttnlwNxM2_Zani_N974cPUmMl1oV_SdbtUyM9d8ZGCIsSvKvKBnrobWnrqVnsEDW4J_SJ4y0aZXDb9uZb1f3C1l69PM Jun 07 14:37:07.332836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 07 14:37:07.332836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 07 14:37:07.332836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 07 14:37:07.332836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 07 14:37:07.332836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 07 14:37:07.332836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 07 14:37:07.332836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:37:07.332836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:07.332836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Role: member,reader Jun 07 14:37:07.332836 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Roles: member,reader Jun 07 14:37:07.334658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a68951caf41c425cb3e1335e30d52a3c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}] Jun 07 14:37:07.334658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:07.334658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:37:07.334658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:07.334658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:37:07.334658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 07 14:37:07.334658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 07 14:37:07.334658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Id: a52df1ab67cb42b69f333adede204a61 Jun 07 14:37:07.334658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:37:07.334658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: method: > Jun 07 14:37:07.334658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: exception: Instance 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb could not be found. Jun 07 14:37:07.334658 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: action_args: {'id': '54d3f092-3c5a-43d0-99c6-ac4f31ba87cb'} Jun 07 14:37:07.335669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:37:07.335669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:07.335669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:37:07.335669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:37:07.335669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:37:07.335669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:37:07.335669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:37:07.335669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:37:07.335669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:37:07.335669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:37:07.335669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb could not be found. Jun 07 14:37:07.335669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:07.335669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:37:07.335669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:07.335669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:07.335669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:37:07.335669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:37:07.335669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:37:07.335669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:37:07.335669 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:37:07.337318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:37:07.337318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:37:07.337318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:37:07.337318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:37:07.337318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:37:07.337318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:37:07.337318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:37:07.337318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb could not be found. Jun 07 14:37:07.337318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:07.337318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:37:07.337318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:07.337318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:07.337318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:37:07.337318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:37:07.337318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:37:07.337318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:37:07.337318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb could not be found. Jun 07 14:37:07.337318 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:07.338791 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-e4bf912d-46c4-4e7e-bafe-44328cc0a524 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Returning 404 to user: Instance 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:37:07.338791 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-e4bf912d-46c4-4e7e-bafe-44328cc0a524 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb" status: 404 len: 111 microversion: 2.1 time: 0.030732 Jun 07 14:37:07.338791 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 531/1098] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:37:07 2022] GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:37:07.343318 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-a497833b-5f18-4d4a-b3d7-b5a665732d12 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '.version_select at 0x7ff3885cd280>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:07.360727 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-a497833b-5f18-4d4a-b3d7-b5a665732d12 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1768096013" status: 202 len: 0 microversion: 2.1 time: 0.021223 Jun 07 14:37:07.361272 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 568/1099] 10.222.0.81 () {58 vars in 1220 bytes} [Tue Jun 7 14:37:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1768096013 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:37:09.086227 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-bdf81682-8724-453a-b3c3-28d2488122d8 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:09.086740 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-bdf81682-8724-453a-b3c3-28d2488122d8 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:37:09.093096 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bdf81682-8724-453a-b3c3-28d2488122d8 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:09.093549 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bdf81682-8724-453a-b3c3-28d2488122d8 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:09.094305 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bdf81682-8724-453a-b3c3-28d2488122d8 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:09.094738 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-bdf81682-8724-453a-b3c3-28d2488122d8 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:09.108148 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-bdf81682-8724-453a-b3c3-28d2488122d8 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] HTTP exception thrown: Instance 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb could not be found. Jun 07 14:37:09.109667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-bdf81682-8724-453a-b3c3-28d2488122d8 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Request method failure captured: Jun 07 14:37:09.109667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: request: DELETE /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb HTTP/1.1 Jun 07 14:37:09.109667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 07 14:37:09.109667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 07 14:37:09.109667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Connection: close Jun 07 14:37:09.109667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 07 14:37:09.109667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 07 14:37:09.109667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Host: 10.222.0.81 Jun 07 14:37:09.109667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 07 14:37:09.109667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 07 14:37:09.109667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABin2GmsS231yllZtsbD6a6Z0roy55x891gPcc4OtdxXF4ia4D01PLG2cf5i38tn1r77Y2duhhtCS-saERLzBOKttnlwNxM2_Zani_N974cPUmMl1oV_SdbtUyM9d8ZGCIsSvKvKBnrobWnrqVnsEDW4J_SJ4y0aZXDb9uZb1f3C1l69PM Jun 07 14:37:09.109667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 07 14:37:09.109667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 07 14:37:09.109667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 07 14:37:09.109667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 07 14:37:09.109667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 07 14:37:09.109667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 07 14:37:09.109667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:37:09.109667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:09.109667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Role: member,reader Jun 07 14:37:09.109667 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Roles: member,reader Jun 07 14:37:09.111348 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a68951caf41c425cb3e1335e30d52a3c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}] Jun 07 14:37:09.111348 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:09.111348 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:37:09.111348 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:09.111348 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:37:09.111348 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 07 14:37:09.111348 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 07 14:37:09.111348 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Id: a52df1ab67cb42b69f333adede204a61 Jun 07 14:37:09.111348 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:37:09.111348 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: method: > Jun 07 14:37:09.111348 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: exception: Instance 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb could not be found. Jun 07 14:37:09.111348 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: action_args: {'id': '54d3f092-3c5a-43d0-99c6-ac4f31ba87cb'} Jun 07 14:37:09.112444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:37:09.112444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:09.112444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:37:09.112444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:37:09.112444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:37:09.112444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:37:09.112444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:37:09.112444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:37:09.112444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:37:09.112444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:37:09.112444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb could not be found. Jun 07 14:37:09.112444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:09.112444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:37:09.112444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:09.112444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:09.112444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:37:09.112444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:37:09.112444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:37:09.112444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:37:09.112444 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:37:09.114046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:37:09.114046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 14:37:09.114046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 14:37:09.114046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 14:37:09.114046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 14:37:09.114046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:37:09.114046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:37:09.114046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:37:09.114046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:37:09.114046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb could not be found. Jun 07 14:37:09.114046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:09.114046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:37:09.114046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:09.114046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:09.114046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:37:09.114046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:37:09.114046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:37:09.114046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:37:09.114046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb could not be found. Jun 07 14:37:09.114046 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:09.115774 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-bdf81682-8724-453a-b3c3-28d2488122d8 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Returning 404 to user: Instance 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:37:09.115774 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-bdf81682-8724-453a-b3c3-28d2488122d8 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "DELETE /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb" status: 404 len: 111 microversion: 2.1 time: 0.029311 Jun 07 14:37:09.115774 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 532/1100] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:37:09 2022] DELETE /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:37:09.119982 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7d1f23a6-7abb-40f3-b7d7-93b633360d69 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:09.120594 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-7d1f23a6-7abb-40f3-b7d7-93b633360d69 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:37:09.127462 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7d1f23a6-7abb-40f3-b7d7-93b633360d69 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:09.127915 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7d1f23a6-7abb-40f3-b7d7-93b633360d69 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:09.128668 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7d1f23a6-7abb-40f3-b7d7-93b633360d69 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:09.129102 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-7d1f23a6-7abb-40f3-b7d7-93b633360d69 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:09.142373 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-7d1f23a6-7abb-40f3-b7d7-93b633360d69 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] HTTP exception thrown: Instance 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb could not be found. Jun 07 14:37:09.144012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7d1f23a6-7abb-40f3-b7d7-93b633360d69 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Request method failure captured: Jun 07 14:37:09.144012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb HTTP/1.1 Jun 07 14:37:09.144012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:37:09.144012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:37:09.144012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:37:09.144012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:37:09.144012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:37:09.144012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:37:09.144012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:37:09.144012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:37:09.144012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin2GmsS231yllZtsbD6a6Z0roy55x891gPcc4OtdxXF4ia4D01PLG2cf5i38tn1r77Y2duhhtCS-saERLzBOKttnlwNxM2_Zani_N974cPUmMl1oV_SdbtUyM9d8ZGCIsSvKvKBnrobWnrqVnsEDW4J_SJ4y0aZXDb9uZb1f3C1l69PM Jun 07 14:37:09.144012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:37:09.144012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:37:09.144012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:37:09.144012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:37:09.144012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:37:09.144012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:37:09.144012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:37:09.144012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:09.144012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:37:09.144012 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:37:09.145735 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a68951caf41c425cb3e1335e30d52a3c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}] Jun 07 14:37:09.145735 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:09.145735 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:37:09.145735 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:09.145735 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:37:09.145735 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:37:09.145735 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:37:09.145735 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: a52df1ab67cb42b69f333adede204a61 Jun 07 14:37:09.145735 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:37:09.145735 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:37:09.145735 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb could not be found. Jun 07 14:37:09.145735 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': '54d3f092-3c5a-43d0-99c6-ac4f31ba87cb'} Jun 07 14:37:09.146912 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:37:09.146912 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:09.146912 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:37:09.146912 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:37:09.146912 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:37:09.146912 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:37:09.146912 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:37:09.146912 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:37:09.146912 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:37:09.146912 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:37:09.146912 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb could not be found. Jun 07 14:37:09.146912 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:37:09.146912 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:37:09.146912 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:37:09.146912 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:09.146912 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:37:09.146912 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:37:09.146912 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:37:09.146912 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:37:09.146912 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:37:09.149280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:37:09.149280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:37:09.149280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:37:09.149280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:37:09.149280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:37:09.149280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:37:09.149280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:37:09.149280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb could not be found. Jun 07 14:37:09.149280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:37:09.149280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:37:09.149280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:37:09.149280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:09.149280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:37:09.149280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:37:09.149280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:37:09.149280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:37:09.149280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb could not be found. Jun 07 14:37:09.149280 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:37:09.150671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-7d1f23a6-7abb-40f3-b7d7-93b633360d69 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Returning 404 to user: Instance 54d3f092-3c5a-43d0-99c6-ac4f31ba87cb could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:37:09.150671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-7d1f23a6-7abb-40f3-b7d7-93b633360d69 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb" status: 404 len: 111 microversion: 2.1 time: 0.029932 Jun 07 14:37:09.150671 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 569/1101] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:37:09 2022] GET /compute/v2.1/servers/54d3f092-3c5a-43d0-99c6-ac4f31ba87cb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 14:37:10.282066 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1df11c98-8886-449e-8e93-3e265206a247 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:10.282544 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-1df11c98-8886-449e-8e93-3e265206a247 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:37:10.289136 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1df11c98-8886-449e-8e93-3e265206a247 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:10.289582 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1df11c98-8886-449e-8e93-3e265206a247 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:10.290342 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1df11c98-8886-449e-8e93-3e265206a247 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:10.290774 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-1df11c98-8886-449e-8e93-3e265206a247 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:10.304019 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-1df11c98-8886-449e-8e93-3e265206a247 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] HTTP exception thrown: Instance e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f could not be found. Jun 07 14:37:10.306389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1df11c98-8886-449e-8e93-3e265206a247 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Request method failure captured: Jun 07 14:37:10.306389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: request: DELETE /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f HTTP/1.1 Jun 07 14:37:10.306389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 07 14:37:10.306389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 07 14:37:10.306389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Connection: close Jun 07 14:37:10.306389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 07 14:37:10.306389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 07 14:37:10.306389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Host: 10.222.0.81 Jun 07 14:37:10.306389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 07 14:37:10.306389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 07 14:37:10.306389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABin2GmsS231yllZtsbD6a6Z0roy55x891gPcc4OtdxXF4ia4D01PLG2cf5i38tn1r77Y2duhhtCS-saERLzBOKttnlwNxM2_Zani_N974cPUmMl1oV_SdbtUyM9d8ZGCIsSvKvKBnrobWnrqVnsEDW4J_SJ4y0aZXDb9uZb1f3C1l69PM Jun 07 14:37:10.306389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 07 14:37:10.306389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 07 14:37:10.306389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 07 14:37:10.306389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 07 14:37:10.306389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 07 14:37:10.306389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 07 14:37:10.306389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:37:10.306389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:10.306389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Role: member,reader Jun 07 14:37:10.306389 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Roles: member,reader Jun 07 14:37:10.308131 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a68951caf41c425cb3e1335e30d52a3c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}] Jun 07 14:37:10.308131 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:10.308131 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:37:10.308131 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:10.308131 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:37:10.308131 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 07 14:37:10.308131 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 07 14:37:10.308131 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Id: a52df1ab67cb42b69f333adede204a61 Jun 07 14:37:10.308131 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:37:10.308131 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: method: > Jun 07 14:37:10.308131 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: exception: Instance e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f could not be found. Jun 07 14:37:10.308131 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: action_args: {'id': 'e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f'} Jun 07 14:37:10.309118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:37:10.309118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:10.309118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:37:10.309118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:37:10.309118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:37:10.309118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:37:10.309118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:37:10.309118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:37:10.309118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:37:10.309118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:37:10.309118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f could not be found. Jun 07 14:37:10.309118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:10.309118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:37:10.309118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:10.309118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:10.309118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:37:10.309118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:37:10.309118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:37:10.309118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:37:10.309118 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:37:10.310679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:37:10.310679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 14:37:10.310679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 14:37:10.310679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 14:37:10.310679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 14:37:10.310679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:37:10.310679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:37:10.310679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:37:10.310679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:37:10.310679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f could not be found. Jun 07 14:37:10.310679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:10.310679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:37:10.310679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:10.310679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:10.310679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:37:10.310679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:37:10.310679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:37:10.310679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:37:10.310679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f could not be found. Jun 07 14:37:10.310679 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:10.312260 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-1df11c98-8886-449e-8e93-3e265206a247 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Returning 404 to user: Instance e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:37:10.312260 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-1df11c98-8886-449e-8e93-3e265206a247 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f" status: 404 len: 111 microversion: 2.1 time: 0.029658 Jun 07 14:37:10.312260 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 533/1102] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:37:10 2022] DELETE /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:37:10.323673 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-269ebbd0-3567-4adf-8dfd-8cd241b57ac6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:10.324302 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-269ebbd0-3567-4adf-8dfd-8cd241b57ac6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:37:10.331037 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-269ebbd0-3567-4adf-8dfd-8cd241b57ac6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:10.331564 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-269ebbd0-3567-4adf-8dfd-8cd241b57ac6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:10.332340 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-269ebbd0-3567-4adf-8dfd-8cd241b57ac6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:10.332784 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-269ebbd0-3567-4adf-8dfd-8cd241b57ac6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:10.346086 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-269ebbd0-3567-4adf-8dfd-8cd241b57ac6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] HTTP exception thrown: Instance e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f could not be found. Jun 07 14:37:10.347630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-269ebbd0-3567-4adf-8dfd-8cd241b57ac6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Request method failure captured: Jun 07 14:37:10.347630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f HTTP/1.1 Jun 07 14:37:10.347630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:37:10.347630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:37:10.347630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:37:10.347630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:37:10.347630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:37:10.347630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:37:10.347630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:37:10.347630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:37:10.347630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin2GmsS231yllZtsbD6a6Z0roy55x891gPcc4OtdxXF4ia4D01PLG2cf5i38tn1r77Y2duhhtCS-saERLzBOKttnlwNxM2_Zani_N974cPUmMl1oV_SdbtUyM9d8ZGCIsSvKvKBnrobWnrqVnsEDW4J_SJ4y0aZXDb9uZb1f3C1l69PM Jun 07 14:37:10.347630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:37:10.347630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:37:10.347630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:37:10.347630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:37:10.347630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:37:10.347630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:37:10.347630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:37:10.347630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:10.347630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:37:10.347630 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:37:10.349252 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a68951caf41c425cb3e1335e30d52a3c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}] Jun 07 14:37:10.349252 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:10.349252 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:37:10.349252 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:10.349252 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:37:10.349252 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:37:10.349252 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:37:10.349252 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: a52df1ab67cb42b69f333adede204a61 Jun 07 14:37:10.349252 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:37:10.349252 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:37:10.349252 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f could not be found. Jun 07 14:37:10.349252 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': 'e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f'} Jun 07 14:37:10.350193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:37:10.350193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:10.350193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:37:10.350193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:37:10.350193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:37:10.350193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:37:10.350193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:37:10.350193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:37:10.350193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:37:10.350193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:37:10.350193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f could not be found. Jun 07 14:37:10.350193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:37:10.350193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:37:10.350193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:37:10.350193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:10.350193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:37:10.350193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:37:10.350193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:37:10.350193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:37:10.350193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:37:10.352615 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:37:10.352615 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:37:10.352615 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:37:10.352615 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:37:10.352615 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:37:10.352615 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:37:10.352615 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:37:10.352615 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f could not be found. Jun 07 14:37:10.352615 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:37:10.352615 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:37:10.352615 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:37:10.352615 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:10.352615 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:37:10.352615 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:37:10.352615 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:37:10.352615 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:37:10.352615 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f could not be found. Jun 07 14:37:10.352615 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:37:10.354051 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-269ebbd0-3567-4adf-8dfd-8cd241b57ac6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Returning 404 to user: Instance e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:37:10.354051 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-269ebbd0-3567-4adf-8dfd-8cd241b57ac6 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f" status: 404 len: 111 microversion: 2.1 time: 0.029878 Jun 07 14:37:10.354051 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 570/1103] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:37:10 2022] GET /compute/v2.1/servers/e64b7d19-1bd0-40bd-bb05-6c3664cf4e1f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:37:10.358381 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8b5e653a-a2ae-4bb3-a8fa-a0c190a0e208 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:10.358906 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-8b5e653a-a2ae-4bb3-a8fa-a0c190a0e208 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 6a645b39-ab55-488a-b7a6-dd126b817efb] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:37:10.364969 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8b5e653a-a2ae-4bb3-a8fa-a0c190a0e208 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:10.365415 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8b5e653a-a2ae-4bb3-a8fa-a0c190a0e208 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:10.366170 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8b5e653a-a2ae-4bb3-a8fa-a0c190a0e208 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:10.366603 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-8b5e653a-a2ae-4bb3-a8fa-a0c190a0e208 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:10.380388 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-8b5e653a-a2ae-4bb3-a8fa-a0c190a0e208 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] HTTP exception thrown: Instance 6a645b39-ab55-488a-b7a6-dd126b817efb could not be found. Jun 07 14:37:10.381900 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8b5e653a-a2ae-4bb3-a8fa-a0c190a0e208 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Request method failure captured: Jun 07 14:37:10.381900 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: request: DELETE /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb HTTP/1.1 Jun 07 14:37:10.381900 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 07 14:37:10.381900 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 07 14:37:10.381900 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Connection: close Jun 07 14:37:10.381900 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 07 14:37:10.381900 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 07 14:37:10.381900 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Host: 10.222.0.81 Jun 07 14:37:10.381900 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 07 14:37:10.381900 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 07 14:37:10.381900 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABin2GmsS231yllZtsbD6a6Z0roy55x891gPcc4OtdxXF4ia4D01PLG2cf5i38tn1r77Y2duhhtCS-saERLzBOKttnlwNxM2_Zani_N974cPUmMl1oV_SdbtUyM9d8ZGCIsSvKvKBnrobWnrqVnsEDW4J_SJ4y0aZXDb9uZb1f3C1l69PM Jun 07 14:37:10.381900 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 07 14:37:10.381900 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 07 14:37:10.381900 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 07 14:37:10.381900 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 07 14:37:10.381900 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 07 14:37:10.381900 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 07 14:37:10.381900 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:37:10.381900 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:10.381900 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Role: member,reader Jun 07 14:37:10.381900 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Roles: member,reader Jun 07 14:37:10.383699 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a68951caf41c425cb3e1335e30d52a3c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}] Jun 07 14:37:10.383699 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:10.383699 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:37:10.383699 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:10.383699 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:37:10.383699 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 07 14:37:10.383699 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 07 14:37:10.383699 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Id: a52df1ab67cb42b69f333adede204a61 Jun 07 14:37:10.383699 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:37:10.383699 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: method: > Jun 07 14:37:10.383699 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: exception: Instance 6a645b39-ab55-488a-b7a6-dd126b817efb could not be found. Jun 07 14:37:10.383699 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: action_args: {'id': '6a645b39-ab55-488a-b7a6-dd126b817efb'} Jun 07 14:37:10.384516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:37:10.384516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:10.384516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:37:10.384516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:37:10.384516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:37:10.384516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:37:10.384516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:37:10.384516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:37:10.384516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:37:10.384516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:37:10.384516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a645b39-ab55-488a-b7a6-dd126b817efb could not be found. Jun 07 14:37:10.384516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:10.384516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:37:10.384516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:10.384516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:10.384516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:37:10.384516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:37:10.384516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:37:10.384516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:37:10.384516 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:37:10.385823 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:37:10.385823 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 14:37:10.385823 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 14:37:10.385823 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 14:37:10.385823 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 14:37:10.385823 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:37:10.385823 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:37:10.385823 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:37:10.385823 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:37:10.385823 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a645b39-ab55-488a-b7a6-dd126b817efb could not be found. Jun 07 14:37:10.385823 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:10.385823 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:37:10.385823 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:10.385823 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:10.385823 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:37:10.385823 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:37:10.385823 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:37:10.385823 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:37:10.385823 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a645b39-ab55-488a-b7a6-dd126b817efb could not be found. Jun 07 14:37:10.385823 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:10.387102 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-8b5e653a-a2ae-4bb3-a8fa-a0c190a0e208 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Returning 404 to user: Instance 6a645b39-ab55-488a-b7a6-dd126b817efb could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:37:10.387102 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-8b5e653a-a2ae-4bb3-a8fa-a0c190a0e208 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb" status: 404 len: 111 microversion: 2.1 time: 0.028721 Jun 07 14:37:10.387102 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 534/1104] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:37:10 2022] DELETE /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:37:10.391597 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ce21bf23-84d0-4219-ad90-7d7290103068 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:10.392239 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-ce21bf23-84d0-4219-ad90-7d7290103068 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 6a645b39-ab55-488a-b7a6-dd126b817efb] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:37:10.398223 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ce21bf23-84d0-4219-ad90-7d7290103068 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:10.398757 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ce21bf23-84d0-4219-ad90-7d7290103068 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:10.399564 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ce21bf23-84d0-4219-ad90-7d7290103068 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:10.400004 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-ce21bf23-84d0-4219-ad90-7d7290103068 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:10.413170 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-ce21bf23-84d0-4219-ad90-7d7290103068 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] HTTP exception thrown: Instance 6a645b39-ab55-488a-b7a6-dd126b817efb could not be found. Jun 07 14:37:10.415312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ce21bf23-84d0-4219-ad90-7d7290103068 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Request method failure captured: Jun 07 14:37:10.415312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb HTTP/1.1 Jun 07 14:37:10.415312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:37:10.415312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:37:10.415312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:37:10.415312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:37:10.415312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:37:10.415312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:37:10.415312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:37:10.415312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:37:10.415312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin2GmsS231yllZtsbD6a6Z0roy55x891gPcc4OtdxXF4ia4D01PLG2cf5i38tn1r77Y2duhhtCS-saERLzBOKttnlwNxM2_Zani_N974cPUmMl1oV_SdbtUyM9d8ZGCIsSvKvKBnrobWnrqVnsEDW4J_SJ4y0aZXDb9uZb1f3C1l69PM Jun 07 14:37:10.415312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:37:10.415312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:37:10.415312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:37:10.415312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:37:10.415312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:37:10.415312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:37:10.415312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:37:10.415312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:10.415312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:37:10.415312 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:37:10.416921 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a68951caf41c425cb3e1335e30d52a3c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}] Jun 07 14:37:10.416921 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:10.416921 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:37:10.416921 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:10.416921 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:37:10.416921 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:37:10.416921 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:37:10.416921 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: a52df1ab67cb42b69f333adede204a61 Jun 07 14:37:10.416921 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:37:10.416921 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:37:10.416921 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance 6a645b39-ab55-488a-b7a6-dd126b817efb could not be found. Jun 07 14:37:10.416921 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': '6a645b39-ab55-488a-b7a6-dd126b817efb'} Jun 07 14:37:10.417885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:37:10.417885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:10.417885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:37:10.417885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:37:10.417885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:37:10.417885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:37:10.417885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:37:10.417885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:37:10.417885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:37:10.417885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:37:10.417885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a645b39-ab55-488a-b7a6-dd126b817efb could not be found. Jun 07 14:37:10.417885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:37:10.417885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:37:10.417885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:37:10.417885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:10.417885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:37:10.417885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:37:10.417885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:37:10.417885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:37:10.417885 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:37:10.419463 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:37:10.419463 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:37:10.419463 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:37:10.419463 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:37:10.419463 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:37:10.419463 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:37:10.419463 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:37:10.419463 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a645b39-ab55-488a-b7a6-dd126b817efb could not be found. Jun 07 14:37:10.419463 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:37:10.419463 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:37:10.419463 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:37:10.419463 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:10.419463 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:37:10.419463 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:37:10.419463 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:37:10.419463 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:37:10.419463 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a645b39-ab55-488a-b7a6-dd126b817efb could not be found. Jun 07 14:37:10.419463 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:37:10.420890 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-ce21bf23-84d0-4219-ad90-7d7290103068 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Returning 404 to user: Instance 6a645b39-ab55-488a-b7a6-dd126b817efb could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:37:10.420890 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-ce21bf23-84d0-4219-ad90-7d7290103068 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb" status: 404 len: 111 microversion: 2.1 time: 0.028879 Jun 07 14:37:10.420890 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 571/1105] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:37:10 2022] GET /compute/v2.1/servers/6a645b39-ab55-488a-b7a6-dd126b817efb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:37:11.548057 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5b0e9481-6f10-49ad-aa9e-cd28cb880070 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:11.548664 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.compute.api [None req-5b0e9481-6f10-49ad-aa9e-cd28cb880070 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] Fetching instance by UUID {{(pid=117564) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:37:11.555803 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5b0e9481-6f10-49ad-aa9e-cd28cb880070 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:11.556249 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5b0e9481-6f10-49ad-aa9e-cd28cb880070 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:11.557009 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5b0e9481-6f10-49ad-aa9e-cd28cb880070 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:11.557440 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG oslo_concurrency.lockutils [None req-5b0e9481-6f10-49ad-aa9e-cd28cb880070 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:11.571390 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.wsgi [None req-5b0e9481-6f10-49ad-aa9e-cd28cb880070 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] HTTP exception thrown: Instance 3e8589c3-e05b-4799-b7d3-badddcf67d38 could not be found. Jun 07 14:37:11.572912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5b0e9481-6f10-49ad-aa9e-cd28cb880070 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Request method failure captured: Jun 07 14:37:11.572912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: request: DELETE /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38 HTTP/1.1 Jun 07 14:37:11.572912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept: application/json Jun 07 14:37:11.572912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Accept-Encoding: identity Jun 07 14:37:11.572912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Connection: close Jun 07 14:37:11.572912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Length: 0 Jun 07 14:37:11.572912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Content-Type: application/json Jun 07 14:37:11.572912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Host: 10.222.0.81 Jun 07 14:37:11.572912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Openstack-System-Scope: None Jun 07 14:37:11.572912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: User-Agent: python-urllib3/1.26.9 Jun 07 14:37:11.572912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Auth-Token: gAAAAABin2GmsS231yllZtsbD6a6Z0roy55x891gPcc4OtdxXF4ia4D01PLG2cf5i38tn1r77Y2duhhtCS-saERLzBOKttnlwNxM2_Zani_N974cPUmMl1oV_SdbtUyM9d8ZGCIsSvKvKBnrobWnrqVnsEDW4J_SJ4y0aZXDb9uZb1f3C1l69PM Jun 07 14:37:11.572912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Id: None Jun 07 14:37:11.572912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Domain-Name: None Jun 07 14:37:11.572912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Identity-Status: Confirmed Jun 07 14:37:11.572912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Is-Admin-Project: True Jun 07 14:37:11.572912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Id: default Jun 07 14:37:11.572912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Domain-Name: Default Jun 07 14:37:11.572912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:37:11.572912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:11.572912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Role: member,reader Jun 07 14:37:11.572912 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Roles: member,reader Jun 07 14:37:11.574521 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a68951caf41c425cb3e1335e30d52a3c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}] Jun 07 14:37:11.574521 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:11.574521 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:37:11.574521 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:11.574521 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:37:11.574521 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Id: default Jun 07 14:37:11.574521 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Domain-Name: Default Jun 07 14:37:11.574521 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Id: a52df1ab67cb42b69f333adede204a61 Jun 07 14:37:11.574521 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: X-User-Name: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:37:11.574521 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: method: > Jun 07 14:37:11.574521 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: exception: Instance 3e8589c3-e05b-4799-b7d3-badddcf67d38 could not be found. Jun 07 14:37:11.574521 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: action_args: {'id': '3e8589c3-e05b-4799-b7d3-badddcf67d38'} Jun 07 14:37:11.575655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: {{(pid=117564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:37:11.575655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:11.575655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:37:11.575655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:37:11.575655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:37:11.575655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:37:11.575655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:37:11.575655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:37:11.575655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:37:11.575655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:37:11.575655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e8589c3-e05b-4799-b7d3-badddcf67d38 could not be found. Jun 07 14:37:11.575655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:11.575655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:37:11.575655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:11.575655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:11.575655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:37:11.575655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:37:11.575655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:37:11.575655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:37:11.575655 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:37:11.577244 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:37:11.577244 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 14:37:11.577244 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 14:37:11.577244 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 14:37:11.577244 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 14:37:11.577244 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:37:11.577244 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:37:11.577244 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:37:11.577244 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:37:11.577244 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e8589c3-e05b-4799-b7d3-badddcf67d38 could not be found. Jun 07 14:37:11.577244 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:11.577244 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:37:11.577244 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:11.577244 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:11.577244 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:37:11.577244 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:37:11.577244 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:37:11.577244 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:37:11.577244 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e8589c3-e05b-4799-b7d3-badddcf67d38 could not be found. Jun 07 14:37:11.577244 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: ERROR nova.api.openstack.wsgi Jun 07 14:37:11.578892 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: DEBUG nova.api.openstack.wsgi [None req-5b0e9481-6f10-49ad-aa9e-cd28cb880070 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Returning 404 to user: Instance 3e8589c3-e05b-4799-b7d3-badddcf67d38 could not be found. {{(pid=117564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:37:11.578892 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO nova.api.openstack.requestlog [None req-5b0e9481-6f10-49ad-aa9e-cd28cb880070 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "DELETE /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38" status: 404 len: 111 microversion: 2.1 time: 0.029972 Jun 07 14:37:11.578892 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: [pid: 117564|app: 0|req: 535/1106] 10.222.0.81 () {58 vars in 1238 bytes} [Tue Jun 7 14:37:11 2022] DELETE /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:37:11.582482 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-86f5741c-363b-47d0-b0ae-331798bbfa82 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Calling method '>' {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:11.583098 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.compute.api [None req-86f5741c-363b-47d0-b0ae-331798bbfa82 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] [instance: 3e8589c3-e05b-4799-b7d3-badddcf67d38] Fetching instance by UUID {{(pid=117565) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:37:11.590193 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-86f5741c-363b-47d0-b0ae-331798bbfa82 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:11.590643 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-86f5741c-363b-47d0-b0ae-331798bbfa82 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:11.591449 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-86f5741c-363b-47d0-b0ae-331798bbfa82 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:11.591891 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG oslo_concurrency.lockutils [None req-86f5741c-363b-47d0-b0ae-331798bbfa82 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Lock "c8a811e3-dd56-4d67-9958-d177193c9c7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:11.605648 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.wsgi [None req-86f5741c-363b-47d0-b0ae-331798bbfa82 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] HTTP exception thrown: Instance 3e8589c3-e05b-4799-b7d3-badddcf67d38 could not be found. Jun 07 14:37:11.607176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-86f5741c-363b-47d0-b0ae-331798bbfa82 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Request method failure captured: Jun 07 14:37:11.607176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: request: GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38 HTTP/1.1 Jun 07 14:37:11.607176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept: application/json Jun 07 14:37:11.607176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Accept-Encoding: identity Jun 07 14:37:11.607176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Connection: close Jun 07 14:37:11.607176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Length: 0 Jun 07 14:37:11.607176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Content-Type: application/json Jun 07 14:37:11.607176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Host: 10.222.0.81 Jun 07 14:37:11.607176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Openstack-System-Scope: None Jun 07 14:37:11.607176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: User-Agent: python-urllib3/1.26.9 Jun 07 14:37:11.607176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Auth-Token: gAAAAABin2GmsS231yllZtsbD6a6Z0roy55x891gPcc4OtdxXF4ia4D01PLG2cf5i38tn1r77Y2duhhtCS-saERLzBOKttnlwNxM2_Zani_N974cPUmMl1oV_SdbtUyM9d8ZGCIsSvKvKBnrobWnrqVnsEDW4J_SJ4y0aZXDb9uZb1f3C1l69PM Jun 07 14:37:11.607176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Id: None Jun 07 14:37:11.607176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Domain-Name: None Jun 07 14:37:11.607176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Identity-Status: Confirmed Jun 07 14:37:11.607176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Is-Admin-Project: True Jun 07 14:37:11.607176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Id: default Jun 07 14:37:11.607176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Domain-Name: Default Jun 07 14:37:11.607176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:37:11.607176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Project-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:11.607176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Role: member,reader Jun 07 14:37:11.607176 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Roles: member,reader Jun 07 14:37:11.608587 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a68951caf41c425cb3e1335e30d52a3c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a68951caf41c425cb3e1335e30d52a3c"}]}] Jun 07 14:37:11.608587 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:11.608587 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Id: a68951caf41c425cb3e1335e30d52a3c Jun 07 14:37:11.608587 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1758546018 Jun 07 14:37:11.608587 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:37:11.608587 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Id: default Jun 07 14:37:11.608587 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Domain-Name: Default Jun 07 14:37:11.608587 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Id: a52df1ab67cb42b69f333adede204a61 Jun 07 14:37:11.608587 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: X-User-Name: tempest-AttachVolumeNegativeTest-1758546018-project Jun 07 14:37:11.608587 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: method: > Jun 07 14:37:11.608587 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: exception: Instance 3e8589c3-e05b-4799-b7d3-badddcf67d38 could not be found. Jun 07 14:37:11.608587 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: action_args: {'id': '3e8589c3-e05b-4799-b7d3-badddcf67d38'} Jun 07 14:37:11.609397 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: {{(pid=117565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:37:11.609397 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:11.609397 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:37:11.609397 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:37:11.609397 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:37:11.609397 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:37:11.609397 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:37:11.609397 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:37:11.609397 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:37:11.609397 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:37:11.609397 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e8589c3-e05b-4799-b7d3-badddcf67d38 could not be found. Jun 07 14:37:11.609397 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:37:11.609397 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:37:11.609397 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:37:11.609397 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:11.609397 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:37:11.609397 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:37:11.609397 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:37:11.609397 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:37:11.609397 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:37:11.610736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:37:11.610736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:37:11.610736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:37:11.610736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:37:11.610736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:37:11.610736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:37:11.610736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:37:11.610736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e8589c3-e05b-4799-b7d3-badddcf67d38 could not be found. Jun 07 14:37:11.610736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:37:11.610736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:37:11.610736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:37:11.610736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:37:11.610736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:37:11.610736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:37:11.610736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:37:11.610736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:37:11.610736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e8589c3-e05b-4799-b7d3-badddcf67d38 could not be found. Jun 07 14:37:11.610736 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: ERROR nova.api.openstack.wsgi Jun 07 14:37:11.612107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: DEBUG nova.api.openstack.wsgi [None req-86f5741c-363b-47d0-b0ae-331798bbfa82 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] Returning 404 to user: Instance 3e8589c3-e05b-4799-b7d3-badddcf67d38 could not be found. {{(pid=117565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:37:11.612107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO nova.api.openstack.requestlog [None req-86f5741c-363b-47d0-b0ae-331798bbfa82 tempest-AttachVolumeNegativeTest-1758546018 tempest-AttachVolumeNegativeTest-1758546018-project] 10.222.0.81 "GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38" status: 404 len: 111 microversion: 2.1 time: 0.029822 Jun 07 14:37:11.612107 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: [pid: 117565|app: 0|req: 572/1107] 10.222.0.81 () {58 vars in 1235 bytes} [Tue Jun 7 14:37:11 2022] GET /compute/v2.1/servers/3e8589c3-e05b-4799-b7d3-badddcf67d38 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:38:04.358691 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 14:38:04.359314 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Tue Jun 7 14:38:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 14:38:20.491290 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 14:38:20.491922 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Tue Jun 7 14:38:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 14:40:01.146936 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 14:40:01.147583 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Tue Jun 7 14:40:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 14:40:11.916538 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 14:40:11.917150 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Tue Jun 7 14:40:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 14:40:19.441131 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 14:40:19.441870 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Tue Jun 7 14:40:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 14:41:24.366892 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 14:41:24.367513 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Tue Jun 7 14:41:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 14:41:40.499751 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 14:41:40.500592 dv-cinder-836083-9-iscsi devstack@n-api.service[117564]: Tue Jun 7 14:41:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 14:41:47.908063 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 14:41:47.908706 dv-cinder-836083-9-iscsi devstack@n-api.service[117565]: Tue Jun 7 14:41:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!